00000001:02000400:0.0F:1788586786.040525:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788586809.681987:0:3189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788586812.386118:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 503 MB/s 00000001:01000000:0.0:1788586812.643691:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 540 MB/s 00000001:01000000:3.0:1788586812.892938:0:3232:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3251 MB/s 00000020:02000000:2.0F:1788586814.112255:0:3281:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_g357faf0 00000400:02000000:3.0:1788586815.702340:0:3296:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.128@tcp [8/256/0/180] 00008000:02000000:2.0:1788586820.201498:0:3446:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788586882.698977:0:5254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788586896.932552:0:5830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788586896.932557:0:5830:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788586896.932690:0:5830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000cceb9335 00000080:02000400:0.0:1788586896.932702:0:5830:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788586896.958537:0:5830:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788586896.958555:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788586896.958630:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005c4415a2) 00000020:00000080:0.0:1788586896.958657:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788586897.018780:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788586897.019202:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788586897.075404:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788586897.075456:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788586897.075478:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788586897.075778:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788586897.075809:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788586897.076354:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788586897.076364:0:5830:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788586897.076375:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab8872a 00000020:01000004:2.0:1788586897.076384:0:5830:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788586897.076389:0:5830:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788586897.076395:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cceb9335 from MGS 00000020:01000004:2.0:1788586897.076399:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788586897.076427:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e031ec34) 00000020:00000080:2.0:1788586897.076439:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788586897.076807:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cceb9335 from MGS, refs=2 00080000:01000000:2.0:1788586897.076814:0:5830:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788586897.076820:0:5830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab88738 00000100:00100000:2.0:1788586897.076963:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788586897.077236:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788586897.077244:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788586897.080498:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788586897.080517:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788586897.081542:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586897.082314:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788586897.082322:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788586897.085389:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788586897.085408:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788586897.086202:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788586897.086212:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788586897.093005:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586897.093013:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586897.093015:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586897.093382:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586897.093386:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586897.093388:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586897.094375:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788586897.096466:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0F:1788586897.349469:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1650 MB/s 00000001:01000000:0.0:1788586897.601833:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1722 MB/s 00000001:01000000:1.0:1788586897.859985:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 379 MB/s 00000001:01000000:2.0:1788586898.111637:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 501 MB/s 00010000:00010000:3.0:1788586898.114993:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788586898.129429:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788586898.163733:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788586898.163751:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788586898.163753:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788586898.167289:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788586898.169416:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788586898.169490:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788586898.169746:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788586898.169772:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788586898.171812:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586898.174653:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788586898.174663:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788586898.180497:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788586898.180524:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788586898.193642:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788586898.193653:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788586898.195578:0:5846:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788586898.195656:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788586898.195678:0:5830:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.128@tcp' 00000020:01000004:1.0:1788586898.195680:0:5830:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788586898.195953:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.128@tcp (typ=mgc) 00000020:00000080:1.0:1788586898.195976:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.128@tcp (0000000025140ded) 00000020:00000080:1.0:1788586898.195994:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788586898.196453:0:5830:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000442f5341@MGC192.168.204.128@tcp: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1788586898.196640:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.128@tcp-0 is initialized 00000040:01000000:1.0:1788586898.196648:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788586898.201602:0:5847:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788586898.201662:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.128@tcp (uuid edb4810b-25f5-40e7-b9fe-d44ac5bbddf3) 00000020:00000080:0.0:1788586898.201689:0:5830:0:(genops.c:1385:class_connect()) connect: client edb4810b-25f5-40e7-b9fe-d44ac5bbddf3, cookie 0xc1a730b05ab88746 00000100:00080000:0.0:1788586898.201705:0:5830:0:(import.c:545:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788586898.201712:0:5830:0:(import.c:665:import_select_connection()) MGC192.168.204.128@tcp: import 00000000442f5341 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788586898.201759:0:5830:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008c63e90c x1875469208125568/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788586898.201788:0:5830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import edb4810b-25f5-40e7-b9fe-d44ac5bbddf3->MGS 00000020:01000004:0.0:1788586898.201807:0:5830:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788586898.201828:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788586898.201873:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f190d2f3) 00000020:00000080:0.0:1788586898.201887:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788586898.214287:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008c63e90c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3311:1875469208125568:0@lo:250: 00000100:00100000:3.0:1788586898.214411:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586898.217700:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208125568 00000100:00100000:1.0:1788586898.217717:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208125568 00000100:00100000:1.0:1788586898.217764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586898.217771:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aec1f9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875469208125568:12345-0@lo:250: 00010000:00080000:1.0:1788586898.217814:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from edb4810b-25f5-40e7-b9fe-d44ac5bbddf3@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1788586898.217920:0:5842:0:(genops.c:1385:class_connect()) connect: client edb4810b-25f5-40e7-b9fe-d44ac5bbddf3, cookie 0xc1a730b05ab88754 00000100:00080000:1.0:1788586898.222757:0:5842:0:(import.c:65:import_set_state_nolock()) 00000000507325d2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788586898.224406:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aec1f9d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:3311:x1875469208125568:12345-0@lo:250: Request processed in 6626us (9988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586898.224421:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586898.228287:0:3311:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788586898.228302:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.128@tcp: connect to target with instance 0 00000100:00080000:3.0:1788586898.228311:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788586898.228317:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788586898.228321:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000442f5341 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788586898.228325:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788586898.228346:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788586898.228357:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008c63e90c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3311:1875469208125568:0@lo:250: 00000100:00100000:1.0:1788586898.261557:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586898.261780:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788586898.261788:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788586898.276058:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788586898.276095:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788586898.278596:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788586898.278615:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788586898.281645:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586898.281908:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788586898.281916:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788586898.287661:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788586898.287680:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788586898.394281:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586898.394495:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788586898.394502:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788586898.398748:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788586898.398763:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788586898.414258:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586898.414480:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788586898.414493:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788586898.419771:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788586898.419786:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788586898.428240:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586898.428464:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788586898.428471:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788586898.432875:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788586898.432890:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788586898.435311:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586898.435551:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788586898.435558:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788586898.438016:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788586898.438215:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788586898.474420:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586898.474729:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788586898.474737:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788586898.476865:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788586898.476881:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788586898.478827:0:5830:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788586898.478873:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788586898.479923:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788586898.479952:0:5830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788586898.479960:0:5830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788586898.480312:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788586898.480356:0:5830:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788586898.480361:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788586898.480363:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788586898.480364:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586898.480365:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586898.480366:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586898.480367:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586898.480369:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586898.480370:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788586898.480372:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586898.480373:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586898.480375:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586898.480377:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788586898.480379:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788586898.480382:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788586898.480383:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788586898.480384:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586898.480385:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586898.480385:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586898.480387:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586898.480387:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586898.480388:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788586898.480389:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586898.480390:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586898.480391:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586898.480392:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788586898.480431:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788586898.480452:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208125696:0@lo:253: 00000100:00100000:3.0:1788586898.480543:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586898.480615:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4157d71 going to sleep for 11 seconds 00000100:00100000:0.0:1788586898.480751:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208125696 00000100:00100000:0.0:1788586898.480762:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208125696 00000100:00100000:0.0:1788586898.480815:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586898.480825:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000782db678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:5830:x1875469208125696:12345-0@lo:253: 20000000:01000000:0.0:1788586898.481981:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788586898.481986:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788586898.482731:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788586898.482794:0:5845:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788586898.483775:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586898.485336:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788586898.485768:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788586898.485772:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788586898.485778:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788586898.485782:0:5845:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788586898.485798:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788586898.487394:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586898.487611:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788586898.487625:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788586898.487672:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788586898.487720:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788586898.487753:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788586898.487928:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788586898.487937:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788586898.487986:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788586898.487994:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788586898.488280:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788586898.488290:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788586898.488322:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788586898.488387:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788586898.489284:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788586898.489298:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788586898.489327:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586898.489567:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788586898.489583:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788586898.489634:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788586898.489668:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788586898.489715:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788586898.489727:0:5845:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788586898.490382:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788586898.490395:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788586898.490463:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788586898.490497:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788586898.490527:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788586898.490538:0:5845:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788586898.490622:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788586898.490631:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788586898.490662:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788586898.490697:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788586898.491357:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788586898.491416:0:5845:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788586898.491424:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788586898.496531:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788586898.497009:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788586898.497296:0:5845:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.128@tcp for mdt 20000000:01000000:1.0:1788586898.497299:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:1.0:1788586898.497343:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788586898.497352:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788586898.497382:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788586898.497390:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:1.0:1788586898.497437:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788586898.497448:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788586898.497477:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788586898.497508:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788586898.497583:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788586898.497587:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788586898.497602:0:5845:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788586898.497610:0:5845:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788586898.498498:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788586898.498724:0:5845:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788586898.511305:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788586898.511362:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1788586898.511448:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1788586898.511470:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788586898.511474:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788586898.511478:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788586898.511493:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788586898.511497:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788586898.511534:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788586898.511537:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788586898.512455:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1788586898.512737:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1788586898.512777:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1788586898.512838:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1788586898.513464:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788586898.513467:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788586898.514308:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788586898.514621:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788586898.514665:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788586898.514702:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788586898.514718:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586898.514721:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1788586898.514730:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788586898.514755:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514775:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514786:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514803:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514812:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514820:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514827:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000154ba124 already unused, calling callback (0000000038f09a24) 00010000:00010000:0.0:1788586898.514831:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514887:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514906:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514914:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586898.514919:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000154ba124/0xc1a730b05ab8875b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788586898.514940:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788586898.778489:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000782db678 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:5830:x1875469208125696:12345-0@lo:253: Request processed in 297654us (297935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586898.778508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586898.778702:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208125696:0@lo:253: 10000000:01000000:3.0:1788586898.778722:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788586898.778726:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788586898.778728:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788586898.778729:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586898.778730:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788586898.778731:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586898.778733:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586898.778734:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788586898.778735:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788586898.778736:0:5830:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788586898.778738:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586898.778740:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788586898.778762:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000cceb9335 from lustre-MDT0000 10000000:01000000:3.0:1788586898.778791:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788586898.778795:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788586898.778800:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8bac912719c0 10000000:01000000:3.0:1788586898.778804:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788586898.778812:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bac912719c0 from 1 10000000:01000000:3.0:1788586898.778815:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788586898.778885:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 0000000047525318/0xc1a730b05ab88762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.778895:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 0000000047525318/0xc1a730b05ab88762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.778905:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 0000000047525318/0xc1a730b05ab88762 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586898.778925:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208125824:0@lo:101: 00000100:00100000:3.0:1788586898.778966:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586898.779156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208125824 00000100:00100000:1.0:1788586898.779164:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208125824 00000100:00100000:3.0:1788586898.779208:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052cacb6d going to sleep for 11 seconds 00000100:00100000:1.0:1788586898.779208:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788586898.779217:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a5fab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:5830:x1875469208125824:12345-0@lo:101: 00010000:00010000:1.0:1788586898.779232:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586898.779247:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002c57dff9/0xc1a730b05ab88769 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88762 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.779284:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002c57dff9/0xc1a730b05ab88769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.779295:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002c57dff9/0xc1a730b05ab88769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.779305:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002c57dff9, rc 0) 00000100:00100000:1.0:1788586898.779374:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a5fab4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+6:5830:x1875469208125824:12345-0@lo:101: Request processed in 158us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586898.779381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586898.779454:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208125824:0@lo:101: 00010000:00010000:3.0:1788586898.779468:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 0000000047525318/0xc1a730b05ab88762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.779477:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 0000000047525318/0xc1a730b05ab88762 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586898.779527:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208125952:0@lo:501: 00000100:00100000:3.0:1788586898.779550:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586898.779568:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052cacb6d going to sleep for 11 seconds 00000100:00100000:1.0:1788586898.779602:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208125952 00000100:00100000:1.0:1788586898.779606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208125952 00000100:00100000:1.0:1788586898.779634:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788586898.779640:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5e439b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+6:5830:x1875469208125952:12345-0@lo:501: 00000100:00100000:0.0:1788586898.780247:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5e439b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+6:5830:x1875469208125952:12345-0@lo:501: Request processed in 606us (694us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788586898.780256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586898.780293:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208125952:0@lo:501: 10000000:01000000:3.0:1788586898.780324:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788586898.780342:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 0000000047525318/0xc1a730b05ab88762 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.780350:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 0000000047525318/0xc1a730b05ab88762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586898.780359:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bac83941800 10000000:01000000:3.0:1788586898.780363:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788586898.780368:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8bac83941800 10000000:01000000:3.0:1788586898.780370:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788586898.780374:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8bac83941800 from 1 10000000:01000000:3.0:1788586898.780376:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788586898.780396:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 000000008571fe90/0xc1a730b05ab88770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.780402:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 000000008571fe90/0xc1a730b05ab88770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.780421:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 000000008571fe90/0xc1a730b05ab88770 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586898.780433:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126080:0@lo:101: 00000100:00100000:3.0:1788586898.780459:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586898.780492:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052cacb6d going to sleep for 11 seconds 00000100:00100000:1.0:1788586898.780501:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126080 00000100:00100000:1.0:1788586898.780505:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126080 00000100:00100000:1.0:1788586898.780541:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586898.780549:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024925490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+6:5830:x1875469208126080:12345-0@lo:101: 00010000:00010000:1.0:1788586898.780558:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586898.780569:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088bc7aff/0xc1a730b05ab88777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88770 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.780588:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088bc7aff/0xc1a730b05ab88777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88770 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.780597:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088bc7aff/0xc1a730b05ab88777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88770 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.780604:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088bc7aff, rc 0) 00000100:00100000:1.0:1788586898.780639:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024925490 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+7:5830:x1875469208126080:12345-0@lo:101: Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586898.780645:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788586898.780812:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126080:0@lo:101: 00010000:00010000:3.0:1788586898.780824:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 000000008571fe90/0xc1a730b05ab88770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.780831:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 000000008571fe90/0xc1a730b05ab88770 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586898.780863:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788586898.780876:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 000000008571fe90/0xc1a730b05ab88770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.780882:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 000000008571fe90/0xc1a730b05ab88770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586898.780888:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788586898.780892:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788586898.780896:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8bac83941800 10000000:01000000:3.0:1788586898.780899:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788586898.780902:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788586898.780904:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586898.780919:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000f08a273f/0xc1a730b05ab8877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.780932:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000f08a273f/0xc1a730b05ab8877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.780938:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000f08a273f/0xc1a730b05ab8877e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586898.780951:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126208:0@lo:101: 00000100:00100000:3.0:1788586898.780976:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586898.781231:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052cacb6d going to sleep for 11 seconds 00000100:00100000:1.0:1788586898.781364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126208 00000100:00100000:1.0:1788586898.781558:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126208 00000100:00100000:1.0:1788586898.781611:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586898.781618:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027a1ff3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+7:5830:x1875469208126208:12345-0@lo:101: 00010000:00010000:1.0:1788586898.781631:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586898.781645:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b431b9af/0xc1a730b05ab88785 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab8877e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.781667:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b431b9af/0xc1a730b05ab88785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.781693:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b431b9af/0xc1a730b05ab88785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586898.781700:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b431b9af, rc 0) 00000100:00100000:1.0:1788586898.781800:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027a1ff3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+8:5830:x1875469208126208:12345-0@lo:101: Request processed in 182us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586898.781807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788586898.781981:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126208:0@lo:101: 00010000:00010000:3.0:1788586898.781994:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000f08a273f/0xc1a730b05ab8877e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586898.782003:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000f08a273f/0xc1a730b05ab8877e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586898.782072:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126336:0@lo:501: 00000100:00100000:3.0:1788586898.782110:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586898.782137:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052cacb6d going to sleep for 11 seconds 00000100:00100000:2.0:1788586898.782277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126336 00000100:00100000:2.0:1788586898.782284:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126336 00000100:00100000:2.0:1788586898.782320:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788586898.782326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055240cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+8:5830:x1875469208126336:12345-0@lo:501: 00000100:00100000:2.0:1788586898.782605:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055240cbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5830:x1875469208126336:12345-0@lo:501: Request processed in 279us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586898.782613:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586898.782876:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126336:0@lo:501: 00000100:00100000:3.0:1788586898.782909:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126464:0@lo:503: 00000100:00100000:3.0:1788586898.782950:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586898.782977:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052cacb6d going to sleep for 11 seconds 00000100:00100000:2.0:1788586898.783034:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126464 00000100:00100000:2.0:1788586898.783039:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126464 00000100:00100000:2.0:1788586898.783070:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586898.783085:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048475c4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5830:x1875469208126464:12345-0@lo:503: 00000100:00100000:2.0:1788586898.783254:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048475c4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5830:x1875469208126464:12345-0@lo:503: Request processed in 170us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586898.783272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788586898.783450:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a5093aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126464:0@lo:503: 00000100:00100000:1.0:1788586898.784242:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000089a96c3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5874:1875469208126592:0@lo:502: 00000100:00100000:1.0:1788586898.784318:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586898.784394:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4ee31da going to sleep for 11 seconds 00000100:00100000:0.0:1788586898.784518:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126592 00000100:00100000:0.0:1788586898.784534:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126592 00000100:00100000:0.0:1788586898.784581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788586898.784589:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077d2b6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5874:x1875469208126592:12345-0@lo:502: 00000100:00100000:0.0:1788586898.784920:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077d2b6f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5874:x1875469208126592:12345-0@lo:502: Request processed in 331us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586898.784928:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788586898.784996:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000089a96c3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5874:1875469208126592:0@lo:502: 00000020:01000000:1.0:1788586898.785022:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586898.785035:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586898.785037:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788586898.785043:0:5874:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788586898.785046:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586898.785060:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000029d4d85b) 00000020:00000080:1.0:1788586898.785221:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788586898.785230:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788586898.785325:0:5874:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788586898.785344:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab88793 00000020:00000080:1.0:1788586898.786172:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788586898.786179:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586898.786184:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586898.786185:0:5874:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788586898.786188:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586898.786199:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586898.786200:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788586898.786203:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586898.786213:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009bd2d7e2) 00000020:00000080:1.0:1788586898.786226:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788586898.786229:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788586898.786231:0:5874:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788586898.786234:0:5874:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788586898.786239:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788586898.786320:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cceb9335 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788586898.786333:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b22b4482) 00000020:00000080:1.0:1788586898.786339:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788586898.786571:0:5874:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788586898.786577:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab887a8 00000020:00000080:1.0:1788586898.786688:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788586898.786694:0:5874:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788586898.786698:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc1a730b05ab887af 00080000:01000000:1.0:1788586898.786704:0:5874:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788586898.786707:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab887b6 00080000:10000000:0.0:1788586898.787733:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788586898.788002:0:5874:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788586898.792950:0:5874:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788586898.915672:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788586898.916490:0:5874:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788586898.919975:0:5874:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788586898.920321:0:5874:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788586898.953624:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000130fbf12) 00000020:00000080:2.0:1788586898.953656:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788586898.953759:0:5874:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788586898.953767:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab887c4 00000020:00000080:2.0:1788586898.955715:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788586898.958737:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788586899.041492:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586899.089319:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1788586899.139254:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788586899.141587:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788586899.207575:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586899.345934:0:5874:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788586899.443898:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc1a730b05ab887cb 00000020:00000080:3.0:1788586899.445701:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788586899.445718:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586899.445727:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586899.445729:0:5874:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788586899.445732:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586899.445738:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586899.445740:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788586899.445744:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788586899.445796:0:5874:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788586899.445811:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586899.445814:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586899.445816:0:5874:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788586899.445818:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586899.445820:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586899.445821:0:5874:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788586899.445823:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788586899.445825:0:5874:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788586899.445909:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5874:1875469208126720:0@lo:502: 00000100:00100000:3.0:1788586899.446032:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586899.446563:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126720 00000100:00100000:2.0:1788586899.446573:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126720 00000100:00100000:2.0:1788586899.446632:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586899.446641:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de8e5dbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5874:x1875469208126720:12345-0@lo:502: 00000100:00100000:3.0:1788586899.448275:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 000000000204a521 going to sleep for 11 seconds 00000100:00100000:2.0:1788586899.448433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de8e5dbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5874:x1875469208126720:12345-0@lo:502: Request processed in 1788us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586899.448447:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586899.449045:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5874:1875469208126720:0@lo:502: 00000020:01000000:3.0:1788586899.449549:0:5874:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586899.449560:0:5874:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586899.449563:0:5874:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788586899.449568:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788586899.449891:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788586899.449921:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788586899.449950:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000f08a273f/0xc1a730b05ab8877e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.449976:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000f08a273f/0xc1a730b05ab8877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586899.449985:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac83941800 from 1 10000000:01000000:1.0:1788586899.449989:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788586899.450044:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.450148:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.450159:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586899.450183:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000089a96c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126848:0@lo:101: 00000100:00100000:1.0:1788586899.450261:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586899.450314:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000000540dd60 going to sleep for 11 seconds 00000100:00100000:2.0:1788586899.450664:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126848 00000100:00100000:2.0:1788586899.450672:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126848 00000100:00100000:2.0:1788586899.450718:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586899.450726:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000024db55d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:5830:x1875469208126848:12345-0@lo:101: 00010000:00010000:2.0:1788586899.450749:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586899.450765:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab887d2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586899.450789:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586899.450799:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586899.450808:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ad6803a, rc 0) 00000100:00100000:2.0:1788586899.450886:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000024db55d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:5830:x1875469208126848:12345-0@lo:101: Request processed in 160us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586899.450893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788586899.451063:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000089a96c3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126848:0@lo:101: 00010000:00010000:3.0:1788586899.452512:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586899.452526:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586899.457763:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126976:0@lo:256: 00000100:00100000:3.0:1788586899.457879:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586899.457935:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000000204a521 going to sleep for 11 seconds 00000100:00100000:2.0:1788586899.458015:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208126976 00000100:00100000:2.0:1788586899.458026:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208126976 00000100:00100000:2.0:1788586899.458088:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788586899.458097:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024f32776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:5830:x1875469208126976:12345-0@lo:256: 20000000:01000000:2.0:1788586899.458125:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788586899.458131:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788586899.458227:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024f32776 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:5830:x1875469208126976:12345-0@lo:256: Request processed in 131us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586899.458235:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788586899.458594:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208126976:0@lo:256: 10000000:01000000:3.0:1788586899.459242:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788586899.459267:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586899.459279:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586899.459287:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac83941800 from 1 10000000:01000000:3.0:1788586899.459291:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788586899.459328:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586899.459335:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586899.459344:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586899.459360:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127104:0@lo:101: 00000100:00100000:3.0:1788586899.459404:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586899.459440:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000000204a521 going to sleep for 11 seconds 00000100:00100000:1.0:1788586899.459656:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208127104 00000100:00100000:1.0:1788586899.459664:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208127104 00000100:00100000:1.0:1788586899.459710:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788586899.459716:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004826ce09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:5830:x1875469208127104:12345-0@lo:101: 00010000:00010000:1.0:1788586899.459727:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586899.459740:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab887e0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.459762:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.459771:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.459778:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d09f04e, rc 0) 00000100:00100000:1.0:1788586899.459813:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004826ce09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5830:x1875469208127104:12345-0@lo:101: Request processed in 97us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586899.459819:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788586899.460003:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127104:0@lo:101: 00010000:00010000:3.0:1788586899.460016:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586899.462381:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586899.462504:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127232:0@lo:501: 00000100:00100000:3.0:1788586899.462585:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586899.462643:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000000204a521 going to sleep for 11 seconds 00000100:00100000:0.0:1788586899.463201:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208127232 00000100:00100000:0.0:1788586899.463213:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208127232 00000100:00100000:0.0:1788586899.463277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586899.463286:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdedc6f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5830:x1875469208127232:12345-0@lo:501: 00000100:00100000:0.0:1788586899.463782:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdedc6f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5830:x1875469208127232:12345-0@lo:501: Request processed in 496us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586899.463789:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788586899.465312:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127232:0@lo:501: 00000100:00100000:3.0:1788586899.465387:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127360:0@lo:503: 00000100:00100000:3.0:1788586899.465486:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586899.465520:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 000000000204a521 going to sleep for 11 seconds 00000100:00100000:2.0:1788586899.465815:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208127360 00000100:00100000:2.0:1788586899.465824:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208127360 00000100:00100000:2.0:1788586899.465902:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788586899.465910:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f8bc57b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5830:x1875469208127360:12345-0@lo:503: 00000040:00080000:2.0:1788586899.465967:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788586899.466019:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f8bc57b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5830:x1875469208127360:12345-0@lo:503: Request processed in 110us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586899.466026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788586899.467456:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127360:0@lo:503: 00000040:00080000:3.0:1788586899.474745:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788586899.475637:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788586899.475663:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788586899.475680:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.475693:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586899.475750:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788586899.475753:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bac83941800 10000000:01000000:0.0:1788586899.475756:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bac83941800 10000000:01000000:0.0:1788586899.475760:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788586899.475782:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bac83941800 from 1 10000000:01000000:0.0:1788586899.475785:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788586899.475825:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000154ba124/0xc1a730b05ab887ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.475832:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000154ba124/0xc1a730b05ab887ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.476913:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000154ba124/0xc1a730b05ab887ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586899.476956:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127488:0@lo:101: 00000100:00100000:0.0:1788586899.477029:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586899.477181:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208127488 00000100:00100000:1.0:1788586899.477204:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208127488 00000100:00100000:1.0:1788586899.477292:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788586899.477300:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bae7bf95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5830:x1875469208127488:12345-0@lo:101: 00010000:00010000:1.0:1788586899.477317:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586899.477332:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049c1e275/0xc1a730b05ab887f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab887ee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.477360:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049c1e275/0xc1a730b05ab887f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.477371:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049c1e275/0xc1a730b05ab887f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.477380:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049c1e275, rc 0) 00000100:00100000:1.0:1788586899.477421:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bae7bf95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5830:x1875469208127488:12345-0@lo:101: Request processed in 122us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586899.477428:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586899.477893:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae7f72f4 going to sleep for 11 seconds 00000100:00100000:0.0:1788586899.477926:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127488:0@lo:101: 00010000:00010000:0.0:1788586899.477946:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000154ba124/0xc1a730b05ab887ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.477955:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000154ba124/0xc1a730b05ab887ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586899.478023:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127616:0@lo:501: 00000100:00100000:0.0:1788586899.478057:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586899.479329:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae7f72f4 going to sleep for 11 seconds 00000100:00100000:3.0:1788586899.484274:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208127616 00000100:00100000:3.0:1788586899.484296:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208127616 00000100:00100000:2.0:1788586899.484512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788586899.484524:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4ddaafc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5830:x1875469208127616:12345-0@lo:501: 00000100:00100000:2.0:1788586899.484946:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4ddaafc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5830:x1875469208127616:12345-0@lo:501: Request processed in 423us (6887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586899.484955:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788586899.485089:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127616:0@lo:501: 00000100:00100000:0.0:1788586899.485162:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127744:0@lo:503: 00000100:00100000:0.0:1788586899.485227:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586899.485774:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae7f72f4 going to sleep for 11 seconds 00000100:00100000:1.0:1788586899.485893:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208127744 00000100:00100000:1.0:1788586899.485901:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208127744 00000100:00100000:1.0:1788586899.485937:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788586899.485945:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010c68086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5830:x1875469208127744:12345-0@lo:503: 00000100:00100000:1.0:1788586899.486334:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010c68086 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5830:x1875469208127744:12345-0@lo:503: Request processed in 390us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586899.486342:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788586899.486455:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208127744:0@lo:503: 00000100:00100000:0.0:1788586899.486989:0:5879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5879:1875469208127872:0@lo:502: 00000100:00100000:0.0:1788586899.487028:0:5879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586899.487221:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208127872 00000100:00100000:1.0:1788586899.487227:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208127872 00000100:00100000:1.0:1788586899.487270:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788586899.487278:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b5c370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5879:x1875469208127872:12345-0@lo:502: 00000100:00100000:1.0:1788586899.487547:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b5c370 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5879:x1875469208127872:12345-0@lo:502: Request processed in 269us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586899.487561:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586899.487726:0:5879:0:(client.c:2716:ptlrpc_set_wait()) set 00000000111d7f85 going to sleep for 11 seconds 00000100:00100000:0.0:1788586899.487745:0:5879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5879:1875469208127872:0@lo:502: 00000020:01000004:0.0:1788586899.487809:0:5879:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788586899.487826:0:5879:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000017a90a17) 00000020:00000080:0.0:1788586899.487885:0:5879:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788586899.487973:0:5879:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000cceb9335 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788586899.487977:0:5879:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000cceb9335 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788586899.487981:0:5879:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000cceb9335 4 00010000:00080000:0.0:1788586899.488009:0:5879:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008bd9ea6d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1788586899.491201:0:5879:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788586899.491403:0:5879:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788586899.491444:0:5879:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788586899.491459:0:5879:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc1a730b05ab88803 00000100:00080000:1.0:1788586899.491471:0:5879:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586899.491477:0:5879:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008bd9ea6d using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1788586899.491513:0:5879:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e26f2293 x1875469208128000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788586899.491538:0:5879:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788586899.492000:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e26f2293 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208128000:0@lo:38: 00000100:00100000:2.0:1788586899.492091:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586899.493926:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128000 00000100:00100000:1.0:1788586899.493942:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128000 00000100:00100000:1.0:1788586899.494001:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586899.494010:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089479954 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875469208128000:12345-0@lo:38: 00000100:00100000:1.0:1788586899.495613:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089479954 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875469208128000:12345-0@lo:38: Request processed in 1597us (3516us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788586899.495626:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586899.495806:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586899.495816:0:3311:0:(import.c:65:import_set_state_nolock()) 000000008bd9ea6d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788586899.495821:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788586899.495824:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e26f2293 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208128000:0@lo:38: 00000100:00100000:1.0:1788586899.498805:0:5879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006935e620 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5879:1875469208128128:0@lo:502: 00000100:00100000:1.0:1788586899.498929:0:5879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586899.498977:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128128 00000100:00100000:1.0:1788586899.498985:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128128 00000100:00100000:1.0:1788586899.499035:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788586899.499044:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef700d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5879:x1875469208128128:12345-0@lo:502: 00000100:00100000:0.0:1788586899.506921:0:5879:0:(client.c:2716:ptlrpc_set_wait()) set 0000000030dafb1f going to sleep for 11 seconds 00000100:00100000:1.0:1788586899.510283:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef700d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5879:x1875469208128128:12345-0@lo:502: Request processed in 11230us (11344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586899.510302:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788586899.513734:0:5879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006935e620 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5879:1875469208128128:0@lo:502: 00000040:00080000:1.0:1788586899.514376:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788586899.514623:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788586899.514645:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586899.514665:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000154ba124/0xc1a730b05ab887ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.514678:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000154ba124/0xc1a730b05ab887ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788586899.514735:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788586899.514738:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788586899.514740:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586899.514741:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586899.514742:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586899.514744:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586899.514745:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788586899.514752:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788586899.514754:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586899.514755:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586899.514756:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586899.514757:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788586899.514761:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788586899.514763:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788586899.514764:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788586899.514765:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586899.514766:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586899.514767:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586899.514768:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586899.514768:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788586899.514769:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788586899.514770:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586899.514770:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586899.514771:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586899.514772:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788586899.514800:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788586899.514822:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208128256:0@lo:253: 00000100:00100000:0.0:1788586899.515161:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586899.517573:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050706970 going to sleep for 11 seconds 00000100:00100000:3.0:1788586899.518309:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128256 00000100:00100000:3.0:1788586899.518321:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128256 00000100:00100000:2.0:1788586899.518552:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586899.518562:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002012ee6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5830:x1875469208128256:12345-0@lo:253: 20000000:01000000:2.0:1788586899.518615:0:5845:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788586899.518630:0:5845:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788586899.579838:0:5845:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788586899.579883:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788586899.580100:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788586899.580106:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788586899.580129:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.580149:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.580158:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.580210:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.580310:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 12 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586899.580326:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007a80a8eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875469208128384:0@lo:104: 00000100:00100000:0.0:1788586899.580390:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586899.580500:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d403ba3c going to sleep for 11 seconds 00000100:00100000:3.0:1788586899.586706:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128384 00000100:00100000:3.0:1788586899.586726:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128384 00000100:00100000:3.0:1788586899.587480:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586899.587494:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064ffb9c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5866:x1875469208128384:12345-0@lo:104: 00010000:00010000:3.0:1788586899.587512:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586899.587614:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586899.587633:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064ffb9c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5866:x1875469208128384:12345-0@lo:104: Request processed in 145us (7243us total) trans 0 rc 0/0 00010000:00010000:1.0:1788586899.587861:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788586899.587867:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.587874:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db4b0bd7 already unused, calling callback (00000000f0eb6132) 10000000:00010000:1.0:1788586899.587877:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.587885:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788586899.587890:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586899.587896:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788586899.587939:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.587945:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788586899.587963:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.587969:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: 00000000db4b0bd7/0xc1a730b05ab887d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887d9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.587988:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586899.587990:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586899.587991:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586899.588103:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208128512:0@lo:103: 00000100:00100000:1.0:1788586899.588141:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586899.588238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128512 00000100:00100000:1.0:1788586899.588245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128512 00010000:00010000:1.0:1788586899.588277:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 13 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586899.588301:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586899.588307:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c732956 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3313:x1875469208128512:12345-0@lo:103: 00010000:00010000:1.0:1788586899.588317:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586899.588321:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 13 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588331:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 13 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588348:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588356:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788586899.588370:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008264451s 00010000:00010000:1.0:1788586899.588373:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588379:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588384:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588389:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588401:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000031fd76cb already unused, calling callback (0000000038f09a24) 00010000:00010000:1.0:1788586899.588405:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588411:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588418:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586899.588427:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586899.588458:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c732956 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3313:x1875469208128512:12345-0@lo:103: Request processed in 152us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586899.588464:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586899.588505:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208128512:0@lo:103: 00000100:00100000:3.0:1788586899.588793:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788586899.590029:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ad6803a/0xc1a730b05ab887d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab887d2 expref: 12 pid: 5845 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586899.590053:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007a80a8eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875469208128384:0@lo:104: 00010000:00010000:0.0:1788586899.590073:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.590082:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.590088:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586899.590092:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000031fd76cb/0xc1a730b05ab8880a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586899.606834:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002012ee6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5830:x1875469208128256:12345-0@lo:253: Request processed in 88266us (91666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586899.606875:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788586899.607203:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5830:1875469208128256:0@lo:253: 10000000:01000000:0.0:1788586899.607220:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788586899.607223:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788586899.607225:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788586899.607227:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586899.607228:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586899.607230:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586899.607263:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586899.607265:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788586899.607266:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788586899.607268:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586899.607269:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586899.607270:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586899.607272:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788586899.607286:0:5830:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788586899.618595:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586899.619942:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788586899.620375:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586899.620638:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788586899.626222:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586899.627298:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586899.630970:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586899.631376:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586899.631602:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586899.631784:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586899.632309:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586899.634201:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788586899.784355:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788586899.878763:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788586899.879318:0:5884:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788586899.879324:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788586899.882876:0:5885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788586899.900601:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788586899.913727:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788586899.914291:0:5830:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788586899.914306:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788586899.914518:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586899.924930:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788586899.927974:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788586899.929041:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788586899.929363:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788586899.929558:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788586899.936992:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788586899.941238:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788586899.941460:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788586899.942272:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788586899.942446:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788586899.944772:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788586899.946795:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788586899.947028:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788586899.947186:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788586899.947336:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788586899.947487:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788586899.947641:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788586899.954966:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788586899.955201:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788586899.955364:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788586899.955510:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788586899.955907:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788586899.956071:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788586899.956220:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788586899.956384:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788586899.956513:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788586899.956642:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788586899.956778:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788586899.956971:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788586899.957112:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788586899.957253:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788586899.958208:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788586899.958431:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788586899.958567:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788586899.959061:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788586899.959203:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788586899.959373:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788586899.959596:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788586899.972818:0:5885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788586900.143712:0:5830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788586900.143762:0:5830:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0e201c8f988 00100000:10000000:2.0:1788586900.143771:0:5830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788586900.144804:0:5830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788586900.144825:0:5830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788586900.144865:0:5830:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788586900.144901:0:5830:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788586900.165513:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788586900.251491:0:5885:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788586900.251583:0:5885:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788586900.251589:0:5885:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788586901.189386:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586902.214810:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586903.235384:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586904.268796:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788586904.582872:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788586904.582883:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788586904.582887:0:38:0:(import.c:65:import_set_state_nolock()) 000000008bd9ea6d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788586904.582913:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008bd9ea6d using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1788586904.582937:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef66c328 x1875469208128768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788586904.589320:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ef66c328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208128768:0@lo:38: 00000100:00100000:1.0:1788586904.589400:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586904.589590:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128768 00000100:00100000:1.0:1788586904.589599:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128768 00000100:00100000:1.0:1788586904.590529:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586904.590538:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000550ee065 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875469208128768:12345-0@lo:38: 00010000:00080000:1.0:1788586904.590567:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:1.0:1788586904.590608:0:5852:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc1a730b05ab88811 00000100:00100000:0.0:1788586904.590782:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208128640:0@lo:400: 00000100:00100000:0.0:1788586904.590837:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586904.590890:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128640 00000100:00100000:0.0:1788586904.590895:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128640 00000004:00100000:1.0:1788586904.594781:0:5852:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788586904.594971:0:5852:0:(import.c:65:import_set_state_nolock()) 000000002e195270 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788586904.595084:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000550ee065 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875469208128768:12345-0@lo:38: Request processed in 4545us (5682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586904.595095:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788586904.595328:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ef66c328 x1875469208128768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788586904.595346:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788586904.595356:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788586904.595360:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788586904.595362:0:3311:0:(import.c:65:import_set_state_nolock()) 000000008bd9ea6d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788586904.595368:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ef66c328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208128768:0@lo:38: 00000100:00100000:0.0:1788586904.597034:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788586904.597048:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b44b414e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:3314:x1875469208128640:12345-0@lo:400: 00000100:00100000:0.0:1788586904.597138:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b44b414e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:3314:x1875469208128640:12345-0@lo:400: Request processed in 94us (6301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586904.597174:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788586904.599216:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208128640:0@lo:400: 00010000:00010000:2.0:1788586905.287677:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788586906.169346:0:6128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788586906.307180:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586907.331599:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788586907.653148:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788586907.653156:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac83941800 from 3 10000000:01000000:2.0:1788586907.653161:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788586907.654879:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 00000000f32a9838/0xc1a730b05ab88818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586907.654897:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 00000000f32a9838/0xc1a730b05ab88818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586907.654908:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 00000000f32a9838/0xc1a730b05ab88818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586907.654931:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a1d3822 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208128896:0@lo:101: 00000100:00100000:2.0:1788586907.655003:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586907.655056:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000461a40e8 going to sleep for 11 seconds 00000100:00100000:3.0:1788586907.655151:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208128896 00000100:00100000:3.0:1788586907.655160:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208128896 00000100:00100000:3.0:1788586907.655228:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586907.655236:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028bbf4a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5847:x1875469208128896:12345-0@lo:101: 00010000:00010000:3.0:1788586907.655249:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586907.655275:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3b183e0/0xc1a730b05ab8881f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88818 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586907.655299:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3b183e0/0xc1a730b05ab8881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586907.655308:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3b183e0/0xc1a730b05ab8881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586907.655317:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3b183e0, rc 0) 00000100:00100000:3.0:1788586907.655360:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028bbf4a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208128896:12345-0@lo:101: Request processed in 125us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586907.655367:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586907.655421:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a1d3822 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208128896:0@lo:101: 00010000:00010000:3.0:1788586907.655436:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 00000000f32a9838/0xc1a730b05ab88818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586907.655444:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 00000000f32a9838/0xc1a730b05ab88818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586907.655496:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129024:0@lo:256: 00000100:00100000:3.0:1788586907.655526:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586907.655541:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022ccb08c going to sleep for 11 seconds 00000100:00100000:3.0:1788586907.655554:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129024 00000100:00100000:3.0:1788586907.655557:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129024 00000100:00100000:3.0:1788586907.655579:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586907.655584:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097f9ce26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208129024:12345-0@lo:256: 20000000:01000000:3.0:1788586907.655597:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788586907.655614:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788586907.655618:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788586907.655835:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097f9ce26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208129024:12345-0@lo:256: Request processed in 250us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586907.655869:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586907.655901:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129024:0@lo:256: 10000000:01000000:3.0:1788586907.655939:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788586907.655945:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: 00000000f32a9838/0xc1a730b05ab88818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586907.655953:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: 00000000f32a9838/0xc1a730b05ab88818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586908.357017:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586909.392370:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586909.708458:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788586909.708489:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208129152:0@lo:400: 00000100:00100000:3.0:1788586909.708575:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586909.708636:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee06f9f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208129280:0@lo:400: 00000100:00100000:3.0:1788586909.708670:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586909.708715:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129152 00000100:00100000:3.0:1788586909.708723:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129152 00000100:00100000:3.0:1788586909.708767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586909.708776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056eb6f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3314:x1875469208129152:12345-0@lo:400: 00000100:00100000:3.0:1788586909.708831:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056eb6f04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3314:x1875469208129152:12345-0@lo:400: Request processed in 56us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586909.708839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586909.708906:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fdadc31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208129152:0@lo:400: 00000100:00100000:3.0:1788586909.708959:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129280 00000100:00100000:3.0:1788586909.708963:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129280 00000100:00100000:3.0:1788586909.708989:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586909.708995:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000563c748a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208129280:12345-0@lo:400: 00000100:00100000:3.0:1788586909.709028:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000563c748a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208129280:12345-0@lo:400: Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586909.709035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788586909.709074:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee06f9f2 x1875469208129280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586909.709087:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee06f9f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208129280:0@lo:400: 00010000:00010000:0.0:1788586910.405628:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586911.439682:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788586911.832534:0:6330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd98a7fb00 20000000:00000080:2.0:1788586911.832554:0:6330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bacaf18c800 uarg=0000000000000000 20000000:01000000:2.0:1788586911.833835:0:6330:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788586911.835667:0:6330:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788586911.835677:0:6330:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788586911.839127:0:6330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788586911.839146:0:6330:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788586911.851408:0:6330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586911.851704:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788586911.851764:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788586911.852968:0:6330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788586911.853002:0:6330:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788586911.853042:0:6330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586911.853062:0:6330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586911.853070:0:6330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586911.853127:0:6330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586911.853147:0:6330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 11 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586911.853164:0:6330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6330:1875469208129408:0@lo:104: 00000100:00100000:0.0:1788586911.853250:0:6330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586911.853326:0:6330:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a38994ea going to sleep for 11 seconds 00000100:00100000:2.0:1788586911.854220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129408 00000100:00100000:2.0:1788586911.854231:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129408 00000100:00100000:2.0:1788586911.854288:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586911.854299:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a80a8eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:6330:x1875469208129408:12345-0@lo:104: 00010000:00010000:2.0:1788586911.854317:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.854395:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586911.854400:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a80a8eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:6330:x1875469208129408:12345-0@lo:104: Request processed in 104us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586911.854407:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788586911.854441:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586911.854446:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.854453:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a30467bb already unused, calling callback (00000000f0eb6132) 10000000:00010000:2.0:1788586911.854456:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.854464:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586911.854472:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586911.854492:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788586911.854542:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.854549:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586911.854567:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.854582:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: 00000000a30467bb/0xc1a730b05ab887e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887e7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.854597:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586911.854599:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586911.854600:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586911.854619:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b6fccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208129536:0@lo:103: 00000100:00100000:2.0:1788586911.854654:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586911.854713:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129536 00000100:00100000:2.0:1788586911.854718:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129536 00010000:00010000:2.0:1788586911.854734:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 12 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586911.854757:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586911.854763:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcb20396 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3313:x1875469208129536:12345-0@lo:103: 00010000:00010000:2.0:1788586911.854987:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586911.854993:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 12 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855004:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 12 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855048:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855056:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855070:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855076:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855082:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855089:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855094:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006867f5da already unused, calling callback (0000000038f09a24) 00010000:00010000:2.0:1788586911.855098:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855106:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855114:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586911.855123:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586911.855155:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcb20396 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3313:x1875469208129536:12345-0@lo:103: Request processed in 394us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586911.855170:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586911.855212:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b6fccb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208129536:0@lo:103: 00010000:00010000:0.0:1788586911.856064:0:6330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004d09f04e/0xc1a730b05ab887e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab887e0 expref: 11 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586911.856083:0:6330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6330:1875469208129408:0@lo:104: 00010000:00010000:0.0:1788586911.856104:0:6330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586911.856113:0:6330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586911.856119:0:6330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586911.856124:0:6330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006867f5da/0xc1a730b05ab88826 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586912.455156:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788586912.707340:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586912.707354:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac83941800 from 1 10000000:01000000:2.0:1788586912.707360:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586912.707434:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: 0000000079b47336/0xc1a730b05ab8882d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586912.707451:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: 0000000079b47336/0xc1a730b05ab8882d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586912.707464:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: 0000000079b47336/0xc1a730b05ab8882d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586912.707579:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b6fccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129664:0@lo:101: 00000100:00100000:2.0:1788586912.707677:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586912.707883:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb8b7f5f going to sleep for 11 seconds 00000100:00100000:0.0:1788586912.712287:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129664 00000100:00100000:0.0:1788586912.712312:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129664 00000100:00100000:1.0:1788586912.712457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788586912.712497:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce368cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:5847:x1875469208129664:12345-0@lo:101: 00010000:00010000:1.0:1788586912.712524:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586912.712551:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db4b0bd7/0xc1a730b05ab88834 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab8882d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586912.712589:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db4b0bd7/0xc1a730b05ab88834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586912.712604:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db4b0bd7/0xc1a730b05ab88834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586912.712614:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db4b0bd7, rc 0) 00000100:00100000:1.0:1788586912.712743:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce368cc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208129664:12345-0@lo:101: Request processed in 248us (5066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586912.713158:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b6fccb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129664:0@lo:101: 00010000:00010000:0.0:1788586912.713186:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: 0000000079b47336/0xc1a730b05ab8882d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586912.713198:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: 0000000079b47336/0xc1a730b05ab8882d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586912.713310:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129792:0@lo:501: 00000100:00100000:0.0:1788586912.713366:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586912.713409:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a38994ea going to sleep for 11 seconds 00000100:00100000:0.0:1788586912.713430:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129792 00000100:00100000:0.0:1788586912.713447:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129792 00000100:00100000:0.0:1788586912.713495:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788586912.713504:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dd3b4f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208129792:12345-0@lo:501: 00000100:00100000:1.0:1788586912.714059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788586912.714959:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dd3b4f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208129792:12345-0@lo:501: Request processed in 1450us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586912.714973:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788586912.715540:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005c5ff852 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129792:0@lo:501: 00000100:00100000:1.0:1788586912.715612:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129920:0@lo:503: 00000100:00100000:1.0:1788586912.715684:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586912.715732:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cfe0ffac going to sleep for 11 seconds 00000100:00100000:2.0:1788586912.716063:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208129920 00000100:00100000:2.0:1788586912.716073:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208129920 00000100:00100000:2.0:1788586912.716134:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788586912.716143:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000416e763a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208129920:12345-0@lo:503: 00000100:00100000:2.0:1788586912.716374:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000416e763a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208129920:12345-0@lo:503: Request processed in 232us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586912.716383:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788586912.716642:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208129920:0@lo:503: 00000100:00100000:1.0:1788586912.717513:0:6349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6349:1875469208130048:0@lo:502: 00000100:00100000:1.0:1788586912.717587:0:6349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586912.717632:0:6349:0:(client.c:2716:ptlrpc_set_wait()) set 00000000317b6467 going to sleep for 11 seconds 00000100:00100000:2.0:1788586912.717765:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130048 00000100:00100000:2.0:1788586912.717775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130048 00000100:00100000:2.0:1788586912.718150:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788586912.718170:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfdfd702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6349:x1875469208130048:12345-0@lo:502: 00000100:00100000:2.0:1788586912.718400:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfdfd702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6349:x1875469208130048:12345-0@lo:502: Request processed in 233us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586912.718410:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788586912.718515:0:6349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7f9fe32 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6349:1875469208130048:0@lo:502: 00000020:01000000:0.0:1788586912.718550:0:6349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586912.718563:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586912.718566:0:6349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788586912.718574:0:6349:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bac83941800 00000020:00000080:0.0:1788586912.718577:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788586912.718637:0:6349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83051c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6349:1875469208130176:0@lo:502: 00000100:00100000:0.0:1788586912.718683:0:6349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586912.718724:0:6349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac87f5ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586912.719166:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130176 00000100:00100000:1.0:1788586912.719175:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130176 00000100:00100000:1.0:1788586912.719235:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788586912.719245:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6349:x1875469208130176:12345-0@lo:502: 00000100:00100000:1.0:1788586912.719479:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6349:x1875469208130176:12345-0@lo:502: Request processed in 222us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586912.719487:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788586912.719601:0:6349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83051c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6349:1875469208130176:0@lo:502: 00000020:01000000:0.0:1788586912.719632:0:6349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586912.719642:0:6349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586912.719645:0:6349:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788586912.719651:0:6349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788586912.720577:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788586912.720611:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788586912.720624:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586912.720637:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586913.477158:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586914.502375:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586914.819255:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208130432:0@lo:400: 00000100:00100000:0.0:1788586914.819255:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208130304:0@lo:400: 00000100:00100000:2.0:1788586914.819381:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586914.819514:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130432 00000100:00100000:3.0:1788586914.819537:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130432 00000100:00100000:2.0:1788586914.820083:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586914.820097:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208130432:12345-0@lo:400: 00000100:00100000:2.0:1788586914.820176:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5944380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208130432:12345-0@lo:400: Request processed in 83us (796us total) trans 0 rc 0/0 00010000:00080000:3.0:1788586914.820398:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bacb44fad80 x1875469208130432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586914.820418:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208130432:0@lo:400: 00000100:00100000:2.0:1788586914.820475:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586914.823616:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586914.824086:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130304 00000100:00100000:2.0:1788586914.824102:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130304 00000100:00100000:2.0:1788586914.824196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788586914.824209:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3314:x1875469208130304:12345-0@lo:400: 00000100:00100000:2.0:1788586914.824302:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3314:x1875469208130304:12345-0@lo:400: Request processed in 96us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586914.824310:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788586914.827332:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208130304:0@lo:400: 00010000:00010000:3.0:1788586915.526396:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586916.561305:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586917.571089:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586918.595339:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788586919.472184:0:6703:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788586919.472190:0:6703:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788586919.472324:0:6703:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bacaf3ef800 00000020:01000004:0.0:1788586919.472345:0:6703:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788586919.472357:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788586919.472372:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8bac90280000) 00000020:00000080:0.0:1788586919.472398:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788586919.487621:0:6703:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788586919.488049:0:6703:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788586919.510394:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788586919.516256:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788586919.516294:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788586919.518302:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788586919.518453:0:6703:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788586919.519154:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788586919.519168:0:6703:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788586919.519182:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1a730b05ab88842 00000020:01000004:3.0:1788586919.519194:0:6703:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788586919.519223:0:6703:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788586919.519227:0:6703:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788586919.519233:0:6703:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788586919.519238:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788586919.519278:0:6703:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8bacae3acd40) 00000020:00000080:3.0:1788586919.519291:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788586919.520997:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788586919.521336:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788586919.521343:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788586919.528032:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788586919.528048:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788586919.528360:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788586919.528370:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788586919.530813:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586919.531181:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788586919.531188:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788586919.531827:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788586919.531834:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788586919.558998:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788586919.559270:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788586919.559277:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788586919.561406:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788586919.561487:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788586919.564169:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788586919.564189:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788586919.567748:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788586919.568333:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788586919.568341:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788586919.569970:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788586919.569982:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1788586919.619226:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586919.622927:0:6703:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788586919.623211:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788586919.623218:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788586919.624512:0:6703:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788586919.624523:0:6703:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788586919.624938:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788586919.624964:0:6703:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788586919.624970:0:6703:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788586919.652261:0:6703:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788586919.652302:0:6703:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788586919.652306:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788586919.652308:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788586919.652310:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586919.652311:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586919.652312:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586919.652313:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586919.652314:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788586919.652315:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586919.652317:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586919.652318:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586919.652320:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788586919.652324:0:6703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788586919.652326:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788586919.652328:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788586919.652329:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586919.652330:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586919.652330:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586919.652332:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586919.652332:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788586919.652333:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586919.652334:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586919.652335:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586919.652336:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788586919.653285:0:6703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788586919.653310:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208130560:0@lo:253: 00000100:00100000:2.0:1788586919.653403:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.653473:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346540 going to sleep for 11 seconds 00000100:00100000:0.0:1788586919.654187:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130560 00000100:00100000:0.0:1788586919.654196:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130560 00000100:00100000:0.0:1788586919.654263:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788586919.654273:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208130560:12345-0@lo:253: 20000000:01000000:0.0:1788586919.654306:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788586919.654310:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788586919.654316:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788586919.654319:0:5845:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788586919.656790:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788586919.657231:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788586919.657250:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788586919.657289:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788586919.657298:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788586919.657327:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788586919.657543:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788586919.658209:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788586919.658236:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:0.0:1788586919.658238:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:0.0:1788586919.658271:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788586919.658280:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788586919.658337:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788586919.658347:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:0.0:1788586919.658523:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788586919.658544:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788586919.658576:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788586919.658694:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788586919.660330:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788586919.660361:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:0.0:1788586919.660363:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:0.0:1788586919.660545:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788586919.660555:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788586919.660584:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788586919.660593:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:0.0:1788586919.660716:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788586919.660729:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788586919.660760:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788586919.660794:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788586919.660811:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788586919.660814:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788586919.660818:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788586919.660829:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788586919.660833:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788586919.660909:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788586919.660912:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788586919.661957:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788586919.662090:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788586919.662137:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788586919.662565:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788586919.662603:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788586919.662739:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788586919.662754:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788586919.662757:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788586919.663421:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1788586919.663467:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1788586919.663506:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788586919.664254:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788586919.664319:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788586919.664357:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788586919.664475:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788586919.664478:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788586919.665065:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788586919.665279:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788586919.665319:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788586919.665397:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788586919.665420:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788586919.665422:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788586919.665431:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788586919.665449:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665468:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88769 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665476:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88785 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665483:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2051200/0xc1a730b05ab887f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665491:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665531:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2051200/0xc1a730b05ab887f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665544:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2051200/0xc1a730b05ab887f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 12 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.665558:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83051c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208130688:0@lo:104: 00000100:00100000:0.0:1788586919.665633:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586919.665685:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88785 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665694:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 12 pid: 5845 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.665713:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208130816:0@lo:104: 00000100:00100000:0.0:1788586919.665732:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788586919.665757:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88769 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.665765:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88769 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 12 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.665773:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208130944:0@lo:104: 00000100:00100000:0.0:1788586919.665788:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.665796:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb44fd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788586919.666013:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130688 00000100:00100000:2.0:1788586919.666021:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130688 00000100:00100000:2.0:1788586919.666060:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130816 00000100:00100000:2.0:1788586919.666063:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130816 00000100:00100000:2.0:1788586919.666072:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208130944 00000100:00100000:2.0:1788586919.666074:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208130944 00000100:00100000:2.0:1788586919.666086:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586919.666094:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:5845:x1875469208130688:12345-0@lo:104: 00010000:00010000:2.0:1788586919.666107:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666162:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586919.666169:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:5845:x1875469208130688:12345-0@lo:104: Request processed in 76us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.666175:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586919.666193:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586919.666198:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:5845:x1875469208130816:12345-0@lo:104: 00010000:00010000:2.0:1788586919.666207:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666238:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788586919.666242:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:5845:x1875469208130816:12345-0@lo:104: Request processed in 45us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.666248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586919.666258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788586919.666264:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208130944:12345-0@lo:104: 00010000:00010000:2.0:1788586919.666271:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666294:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788586919.666302:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208130944:12345-0@lo:104: Request processed in 39us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.666308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788586919.666325:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788586919.666332:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666339:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac80030600 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586919.666343:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666352:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586919.666359:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586919.666365:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586919.666390:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666397:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586919.666424:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666432:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab887ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab887f5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666457:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586919.666460:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666473:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5e00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586919.666477:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666483:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586919.666489:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586919.666495:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586919.666505:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666511:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586919.666516:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666522:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab8877e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88785 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666530:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586919.666532:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666538:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5600 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586919.666541:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666554:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586919.666561:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586919.666565:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586919.666574:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666579:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586919.666592:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666598:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab88762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88769 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666610:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586919.666612:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586919.666614:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586919.666628:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586919.666649:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208131072:0@lo:103: 00000100:00100000:2.0:1788586919.666680:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.666708:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586919.666713:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208131200:0@lo:103: 00000100:00100000:2.0:1788586919.666731:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.666755:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208131328:0@lo:103: 00000100:00100000:2.0:1788586919.666775:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.666818:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131072 00000100:00100000:2.0:1788586919.666823:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131072 00010000:00010000:2.0:1788586919.666878:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2051200/0xc1a730b05ab887f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 13 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586919.666895:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131200 00000100:00100000:2.0:1788586919.666897:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131200 00010000:00010000:2.0:1788586919.666910:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88785 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 14 pid: 5845 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586919.666918:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131328 00000100:00100000:2.0:1788586919.666920:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131328 00010000:00010000:2.0:1788586919.666927:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88769 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 15 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586919.666939:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586919.666944:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:3312:x1875469208131072:12345-0@lo:103: 00010000:00010000:2.0:1788586919.666954:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586919.666959:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2051200/0xc1a730b05ab887f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 15 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666969:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2051200/0xc1a730b05ab887f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 15 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.666984:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586919.667012:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:3312:x1875469208131072:12345-0@lo:103: Request processed in 68us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.667018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586919.667030:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586919.667035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3312:x1875469208131200:12345-0@lo:103: 00010000:00010000:2.0:1788586919.667042:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586919.667051:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88785 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 14 pid: 5845 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667059:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88785 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 14 pid: 5845 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667068:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586919.667092:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3312:x1875469208131200:12345-0@lo:103: Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.667099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586919.667110:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788586919.667116:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3314:x1875469208131328:12345-0@lo:103: 00010000:00010000:2.0:1788586919.667134:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586919.667139:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88769 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 13 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667148:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88769 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 13 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667159:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667166:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667179:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667186:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667194:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667207:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667212:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac80030200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788586919.667217:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667224:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667232:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.667241:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586919.667268:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3314:x1875469208131328:12345-0@lo:103: Request processed in 153us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.667275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788586919.667313:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208131328:0@lo:103: 00000100:00100000:2.0:1788586919.667339:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208131200:0@lo:103: 00000100:00100000:2.0:1788586919.667347:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208131072:0@lo:103: 00010000:00010000:0.0:1788586919.669037:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2051200/0xc1a730b05ab887f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab887ee expref: 12 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.669057:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83051c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208130688:0@lo:104: 00010000:00010000:0.0:1788586919.669069:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88785 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab8877e expref: 11 pid: 5845 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.669078:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208130816:0@lo:104: 00010000:00010000:0.0:1788586919.669088:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88769 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88762 expref: 10 pid: 5842 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.669095:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208130944:0@lo:104: 00010000:00010000:0.0:1788586919.669118:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.669128:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.669150:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.669155:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030200/0xc1a730b05ab88850 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788586919.669170:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788586919.739642:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:6703:x1875469208130560:12345-0@lo:253: Request processed in 85360us (86228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.739658:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788586919.739803:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208130560:0@lo:253: 10000000:01000000:2.0:1788586919.739820:0:6703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788586919.739824:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788586919.739825:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788586919.739827:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586919.739828:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788586919.739830:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586919.740206:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586919.740208:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788586919.740210:0:6703:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788586919.740213:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586919.740214:0:6703:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788586919.740242:0:6703:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bacaf3ef800 from lustre-OST0000 10000000:01000000:2.0:1788586919.740269:0:6703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788586919.740272:0:6703:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788586919.740279:0:6703:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bac912719c0 local copy 10000000:01000000:2.0:1788586919.740282:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788586919.740326:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.740338:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.740348:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586919.740373:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131456:0@lo:101: 00000100:00100000:2.0:1788586919.740506:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.740607:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.741338:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131456 00000100:00100000:1.0:1788586919.741348:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131456 00000100:00100000:0.0:1788586919.746530:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788586919.746548:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:6703:x1875469208131456:12345-0@lo:101: 00010000:00010000:0.0:1788586919.746569:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586919.746589:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80030200/0xc1a730b05ab8885e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88857 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.746634:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030200/0xc1a730b05ab8885e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88857 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.746645:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80030200/0xc1a730b05ab8885e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88857 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.746654:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80030200, rc 0) 00000100:00100000:0.0:1788586919.746744:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:6703:x1875469208131456:12345-0@lo:101: Request processed in 202us (6238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586919.746751:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788586919.746898:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131456:0@lo:101: 00010000:00010000:3.0:1788586919.746922:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.746933:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586919.747111:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131584:0@lo:501: 00000100:00100000:3.0:1788586919.747147:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.747983:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac852cdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586919.748231:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131584 00000100:00100000:2.0:1788586919.748240:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131584 00000100:00100000:2.0:1788586919.748282:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788586919.748293:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:6703:x1875469208131584:12345-0@lo:501: 00000100:00100000:2.0:1788586919.748554:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:6703:x1875469208131584:12345-0@lo:501: Request processed in 263us (1406us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788586919.748562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788586919.748664:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131584:0@lo:501: 10000000:01000000:3.0:1788586919.748683:0:6703:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788586919.748714:0:6703:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788586919.748722:0:6703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.748731:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.748739:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.748760:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788586919.748783:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bacaf3ef800 10000000:01000000:3.0:1788586919.748794:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788586919.748800:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8bac912719c0 10000000:01000000:3.0:1788586919.748802:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788586919.748805:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8bac912719c0 from 1 10000000:01000000:3.0:1788586919.748808:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788586919.748836:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.748859:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.748884:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586919.748901:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131712:0@lo:101: 00000100:00100000:3.0:1788586919.748934:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.748959:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac852cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.748975:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131712 00000100:00100000:3.0:1788586919.748979:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131712 00000100:00100000:3.0:1788586919.748998:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586919.749017:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+10:6703:x1875469208131712:12345-0@lo:101: 00010000:00010000:3.0:1788586919.749026:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586919.749038:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c5800/0xc1a730b05ab8886c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88865 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749059:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c5800/0xc1a730b05ab8886c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88865 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749069:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c5800/0xc1a730b05ab8886c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88865 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749089:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5800, rc 0) 00000100:00100000:3.0:1788586919.749117:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:6703:x1875469208131712:12345-0@lo:101: Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.749123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788586919.749155:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131712:0@lo:101: 00010000:00010000:3.0:1788586919.749167:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8886c expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749176:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab8886c expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586919.749191:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788586919.749200:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8886c expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749206:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8886c expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586919.749213:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788586919.749217:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788586919.749221:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788586919.749222:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586919.749236:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749243:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749260:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586919.749271:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131840:0@lo:101: 00000100:00100000:3.0:1788586919.749294:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.749306:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac852cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.749319:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131840 00000100:00100000:3.0:1788586919.749322:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131840 00000100:00100000:3.0:1788586919.749339:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788586919.749345:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:6703:x1875469208131840:12345-0@lo:101: 00010000:00010000:3.0:1788586919.749351:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586919.749359:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88873 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749371:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749379:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749385:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4e00, rc 0) 00000100:00100000:3.0:1788586919.749411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208131840:12345-0@lo:101: Request processed in 66us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.749416:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788586919.749443:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131840:0@lo:101: 00010000:00010000:3.0:1788586919.749454:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.749472:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586919.749535:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131968:0@lo:501: 00000100:00100000:3.0:1788586919.749557:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.749570:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac852cd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.749582:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208131968 00000100:00100000:3.0:1788586919.749585:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208131968 00000100:00100000:3.0:1788586919.749602:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788586919.749607:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208131968:12345-0@lo:501: 00000100:00100000:3.0:1788586919.749770:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208131968:12345-0@lo:501: Request processed in 161us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.749777:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788586919.749811:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208131968:0@lo:501: 00000100:00100000:3.0:1788586919.749833:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132096:0@lo:503: 00000100:00100000:3.0:1788586919.749902:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.749914:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.749925:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132096 00000100:00100000:3.0:1788586919.749928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132096 00000100:00100000:3.0:1788586919.749941:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788586919.749946:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132096:12345-0@lo:503: 00000100:00100000:3.0:1788586919.750065:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132096:12345-0@lo:503: Request processed in 118us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.750071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788586919.750106:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132096:0@lo:503: 00000040:00080000:3.0:1788586919.750337:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788586919.750398:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132224:0@lo:502: 00000100:00100000:3.0:1788586919.750425:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.750437:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.750450:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132224 00000100:00100000:3.0:1788586919.750453:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132224 00000100:00100000:3.0:1788586919.750468:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586919.750473:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132224:12345-0@lo:502: 00000100:00100000:3.0:1788586919.750575:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132224:12345-0@lo:502: Request processed in 101us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.750581:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788586919.750610:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132224:0@lo:502: 00000040:00080000:3.0:1788586919.750804:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788586919.750877:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788586919.750910:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788586919.750947:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788586919.750974:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788586919.750999:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788586919.751017:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132352:0@lo:502: 00000100:00100000:3.0:1788586919.751044:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.751057:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.751072:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132352 00000100:00100000:3.0:1788586919.751075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132352 00000100:00100000:3.0:1788586919.751094:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788586919.751100:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132352:12345-0@lo:502: 00000100:00100000:3.0:1788586919.751205:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132352:12345-0@lo:502: Request processed in 103us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.751221:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788586919.751255:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132352:0@lo:502: 00000040:00080000:3.0:1788586919.751321:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788586919.751330:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:2.0:1788586919.752102:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586919.752111:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.752137:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc21c7000 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586919.752141:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.752151:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586919.752158:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586919.752164:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586919.752191:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.752197:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586919.752214:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.752221:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7000/0xc1a730b05ab88857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1a730b05ab8885e expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.752236:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586919.752238:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586919.752239:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586919.752259:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208132480:0@lo:103: 00000100:00100000:2.0:1788586919.752295:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.752340:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132480 00000100:00100000:2.0:1788586919.752345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132480 00000100:00100000:2.0:1788586919.752382:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586919.752397:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3315:x1875469208132480:12345-0@lo:103: 00010000:00010000:2.0:1788586919.752421:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586919.752436:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030200/0xc1a730b05ab8885e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88857 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.752449:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586919.752477:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:3315:x1875469208132480:12345-0@lo:103: Request processed in 82us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.752483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586919.752511:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208132480:0@lo:103: 00000020:01000000:2.0:1788586919.753242:0:6721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788586919.753251:0:6721:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788586919.753257:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586919.753260:0:6721:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788586919.753265:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788586919.753282:0:6721:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8bac88350000) 00000020:00000080:2.0:1788586919.753306:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788586919.753312:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788586919.753398:0:6721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacaf3ef800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788586919.753405:0:6721:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788586919.753423:0:6721:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1a730b05ab88888 00010000:00010000:2.0:1788586919.763810:0:6721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788586919.766484:0:6721:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788586919.770912:0:6721:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788586919.771603:0:6721:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788586919.785429:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788586919.786745:0:6721:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788586919.788804:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788586919.788817:0:6721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586919.788824:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586919.788826:0:6721:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788586919.788830:0:6721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586919.788834:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586919.788836:0:6721:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788586919.788839:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788586919.788873:0:6721:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788586919.788931:0:6721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586919.788934:0:6721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586919.788935:0:6721:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788586919.788939:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788586919.789183:0:6703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788586919.789211:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788586919.789242:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.789275:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586919.789283:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacaf3ef800 from 1 10000000:01000000:0.0:1788586919.789286:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788586919.789332:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.789340:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.789351:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.789378:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132608:0@lo:101: 00000100:00100000:0.0:1788586919.789617:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.789753:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.789894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132608 00000100:00100000:1.0:1788586919.789902:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132608 00000100:00100000:1.0:1788586919.789956:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788586919.789966:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:6703:x1875469208132608:12345-0@lo:101: 00010000:00010000:1.0:1788586919.789983:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586919.790084:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab8888f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586919.790113:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586919.790124:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586919.790132:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051800, rc 0) 00000100:00100000:1.0:1788586919.790178:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132608:12345-0@lo:101: Request processed in 213us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.790184:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788586919.790442:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132608:0@lo:101: 00010000:00010000:0.0:1788586919.790458:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.790467:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.790569:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132736:0@lo:501: 00000100:00100000:0.0:1788586919.790602:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586919.791226:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132736 00000100:00100000:1.0:1788586919.791235:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132736 00000100:00100000:1.0:1788586919.791281:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788586919.791290:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132736:12345-0@lo:501: 00000100:00100000:1.0:1788586919.795816:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132736:12345-0@lo:501: Request processed in 4516us (5203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.795833:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788586919.796059:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788586919.796098:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132736:0@lo:501: 00000100:00100000:0.0:1788586919.796153:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132864:0@lo:503: 00000100:00100000:0.0:1788586919.796204:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.796219:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.796656:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132864 00000100:00100000:1.0:1788586919.796665:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132864 00000100:00100000:1.0:1788586919.796719:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788586919.796729:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132864:12345-0@lo:503: 00000100:00100000:1.0:1788586919.797079:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132864:12345-0@lo:503: Request processed in 351us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.797093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586919.797402:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132864:0@lo:503: 00000040:00080000:0.0:1788586919.797769:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788586919.797917:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132992:0@lo:502: 00000100:00100000:0.0:1788586919.797968:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.797997:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.798351:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208132992 00000100:00100000:1.0:1788586919.798357:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208132992 00000100:00100000:1.0:1788586919.798415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788586919.798424:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132992:12345-0@lo:502: 00000100:00100000:1.0:1788586919.798790:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208132992:12345-0@lo:502: Request processed in 366us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.798798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788586919.801021:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208132992:0@lo:502: 00000040:00080000:2.0:1788586919.801358:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788586919.801568:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788586919.801630:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133120:0@lo:502: 00000100:00100000:2.0:1788586919.801703:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.802181:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac903466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.802268:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208133120 00000100:00100000:3.0:1788586919.802276:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208133120 00000100:00100000:3.0:1788586919.802333:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788586919.802343:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208133120:12345-0@lo:502: 00000100:00100000:3.0:1788586919.802567:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208133120:12345-0@lo:502: Request processed in 224us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.802575:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788586919.802890:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133120:0@lo:502: 00000040:00080000:2.0:1788586919.803027:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788586919.803040:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788586919.804234:0:6725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586919.804249:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586919.804251:0:6725:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788586919.804260:0:6725:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacaf3ef800 00000020:00000080:2.0:1788586919.804262:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788586919.804283:0:6725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586919.804286:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586919.804287:0:6725:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788586919.804290:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788586919.808815:0:6703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788586919.816797:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788586919.816921:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.816935:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586919.817026:0:6703:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788586919.817029:0:6703:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bacaf3ef800 10000000:01000000:0.0:1788586919.817032:0:6703:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bacaf3ef800 10000000:01000000:0.0:1788586919.817037:0:6703:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788586919.817056:0:6703:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bacaf3ef800 from 1 10000000:01000000:0.0:1788586919.817059:0:6703:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788586919.817098:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.817106:0:6703:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.817136:0:6703:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.817164:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133248:0@lo:101: 00000100:00100000:0.0:1788586919.817227:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.817270:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.817498:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208133248 00000100:00100000:1.0:1788586919.817508:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208133248 00000100:00100000:1.0:1788586919.817569:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788586919.817579:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208133248:12345-0@lo:101: 00010000:00010000:1.0:1788586919.817592:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586919.817607:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab8889d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586919.817645:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586919.817657:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586919.817668:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051400, rc 0) 00000100:00100000:1.0:1788586919.817718:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133248:12345-0@lo:101: Request processed in 140us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.817724:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788586919.819617:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133248:0@lo:101: 00010000:00010000:0.0:1788586919.819646:0:6703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.819660:0:6703:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.819793:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133376:0@lo:501: 00000100:00100000:0.0:1788586919.819912:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586919.819995:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208133376 00000100:00100000:2.0:1788586919.820091:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.820122:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208133376 00000100:00100000:1.0:1788586919.820196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788586919.820207:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133376:12345-0@lo:501: 00000100:00100000:1.0:1788586919.820640:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133376:12345-0@lo:501: Request processed in 435us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.820649:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788586919.828478:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133376:0@lo:501: 00000100:00100000:2.0:1788586919.828683:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133504:0@lo:503: 00000100:00100000:2.0:1788586919.828768:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.828818:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac903466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.828825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208133504 00000100:00100000:3.0:1788586919.828834:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208133504 00000100:00100000:3.0:1788586919.828931:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788586919.828942:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133504:12345-0@lo:503: 00000100:00100000:3.0:1788586919.829190:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133504:12345-0@lo:503: Request processed in 249us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.829198:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788586919.829259:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133504:0@lo:503: 00000040:00080000:2.0:1788586919.829800:0:6703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788586919.829905:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133632:0@lo:502: 00000100:00100000:2.0:1788586919.829949:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.829978:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac903466c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.832717:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208133632 00000100:00100000:1.0:1788586919.832734:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208133632 00000100:00100000:1.0:1788586919.832814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788586919.832826:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133632:12345-0@lo:502: 00000100:00100000:1.0:1788586919.833196:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133632:12345-0@lo:502: Request processed in 372us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.833204:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788586919.833273:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133632:0@lo:502: 00000040:00080000:2.0:1788586919.833641:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788586919.833712:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788586919.833750:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788586919.833809:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788586919.833901:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788586919.833955:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788586919.834192:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788586919.834241:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788586919.834298:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788586919.834335:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788586919.834370:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788586919.834419:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788586919.834455:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788586919.834488:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788586919.834534:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788586919.834569:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788586919.834603:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788586919.834669:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788586919.834705:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788586919.834734:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788586919.834782:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788586919.834818:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788586919.837336:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788586919.837468:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788586919.837506:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788586919.837542:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788586919.837585:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788586919.837625:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788586919.837685:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133760:0@lo:502: 00000100:00100000:3.0:1788586919.837784:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.837934:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788586919.844200:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208133760 00000100:00100000:1.0:1788586919.844221:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208133760 00000100:00100000:1.0:1788586919.844345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788586919.844357:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133760:12345-0@lo:502: 00000100:00100000:1.0:1788586919.844660:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208133760:12345-0@lo:502: Request processed in 305us (6875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586919.844668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788586919.844784:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208133760:0@lo:502: 00000040:00080000:0.0:1788586919.844955:0:6703:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788586919.844987:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788586919.846692:0:6726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788586919.846716:0:6726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8bacbf730000) 00000020:00000080:0.0:1788586919.846737:0:6726:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788586919.846818:0:6726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacaf3ef800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788586919.846822:0:6726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bacaf3ef800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788586919.846825:0:6726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacaf3ef800 3 00010000:00080000:0.0:1788586919.846902:0:6726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bacbf738800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.128@tcp at head 00010000:00010000:0.0:1788586919.849007:0:6726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788586919.849210:0:6726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788586919.849249:0:6726:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788586919.849261:0:6726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc1a730b05ab888b2 00000100:00080000:0.0:1788586919.849272:0:6726:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788586919.849278:0:6726:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bacbf738800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788586919.849315:0:6726:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bac83051c00 x1875469208133888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788586919.849344:0:6726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788586919.851380:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208134016:0@lo:400: 00000100:00100000:2.0:1788586919.851465:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.854141:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134016 00000100:00100000:3.0:1788586919.854158:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134016 00000100:00100000:3.0:1788586919.854241:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586919.854250:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208134016:12345-0@lo:400: 00000100:00100000:3.0:1788586919.854352:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208134016:12345-0@lo:400: Request processed in 103us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.854359:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788586919.854409:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bac83053480 x1875469208134016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586919.854424:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208134016:0@lo:400: 00000040:00080000:0.0:1788586919.855022:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1788586919.857678:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875469208133888:0@lo:38: 00000100:00100000:0.0:1788586919.857765:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586919.857911:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208133888 00000100:00100000:2.0:1788586919.857919:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208133888 00000100:00100000:2.0:1788586919.857952:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586919.857960:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875469208133888:12345-0@lo:38: 00010000:00080000:2.0:1788586919.857998:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:2.0:1788586919.858032:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc1a730b05ab888b9 00000004:00100000:2.0:1788586919.858176:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788586919.858213:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8bacbf55e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788586919.858276:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875469208133888:12345-0@lo:38: Request processed in 315us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.858283:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788586919.858333:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bac83051c00 x1875469208133888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586919.858344:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586919.858353:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788586919.858362:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788586919.858367:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788586919.858369:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbf738800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788586919.858375:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875469208133888:0@lo:38: 00000020:01000000:3.0:1788586919.858471:0:6703:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788586919.858505:0:6703:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586919.858528:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.858538:0:6703:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788586919.858594:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788586919.858596:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788586919.858597:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586919.858598:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586919.858599:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586919.858601:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586919.858602:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788586919.858604:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586919.858605:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586919.858607:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586919.858608:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788586919.858613:0:6703:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788586919.858615:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788586919.858617:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788586919.858618:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788586919.858619:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788586919.858626:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788586919.858627:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788586919.858628:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788586919.858629:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788586919.858629:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788586919.858630:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788586919.858631:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788586919.858652:0:6703:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788586919.858666:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208134144:0@lo:253: 00000100:00100000:3.0:1788586919.858702:0:6703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586919.858726:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788586919.858748:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134144 00000100:00100000:3.0:1788586919.858753:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134144 00000100:00100000:3.0:1788586919.858783:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788586919.858790:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:6703:x1875469208134144:12345-0@lo:253: 20000000:01000000:3.0:1788586919.858812:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788586919.858825:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788586919.907825:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788586919.908034:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 20000000:01000000:3.0:1788586919.908176:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 10000000:01000000:0.0:1788586919.908215:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788586919.908239:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.908259:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac829c5a00/0xc1a730b05ab8881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.908269:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.908311:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac829c5a00/0xc1a730b05ab8881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.908326:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac829c5a00/0xc1a730b05ab8881f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 13 pid: 5845 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.908342:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875469208134272:0@lo:104: 00000100:00100000:0.0:1788586919.908656:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.908740:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788586919.908993:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134272 00000100:00100000:2.0:1788586919.909008:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134272 00000100:00100000:2.0:1788586919.909077:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788586919.909088:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5866:x1875469208134272:12345-0@lo:104: 00010000:00010000:2.0:1788586919.909104:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586919.909441:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788586919.909449:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5866:x1875469208134272:12345-0@lo:104: Request processed in 363us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586919.909456:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788586919.909590:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788586919.909598:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.909607:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc21c7a00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788586919.909611:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.909629:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586919.909637:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586919.909644:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788586919.909681:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.909688:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586919.909709:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.909716:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7a00/0xc1a730b05ab88818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8881f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.909733:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586919.909735:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586919.909736:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586919.909750:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208134400:0@lo:103: 00000100:00100000:0.0:1788586919.909790:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586919.909894:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134400 00000100:00100000:0.0:1788586919.909901:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134400 00010000:00010000:0.0:1788586919.909922:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac829c5a00/0xc1a730b05ab8881f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 14 pid: 5845 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586919.909947:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586919.909955:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88341050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3313:x1875469208134400:12345-0@lo:103: 00010000:00010000:0.0:1788586919.909968:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586919.909975:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac829c5a00/0xc1a730b05ab8881f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 14 pid: 5845 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.909986:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac829c5a00/0xc1a730b05ab8881f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 14 pid: 5845 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910007:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910016:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788586919.910031:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008264451s 00010000:00010000:0.0:1788586919.910036:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910043:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910061:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910069:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910085:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac80030000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788586919.910090:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910098:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910108:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586919.910122:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586919.910166:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88341050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3313:x1875469208134400:12345-0@lo:103: Request processed in 212us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586919.910173:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586919.910325:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208134400:0@lo:103: 00010000:00010000:3.0:1788586919.910897:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c5a00/0xc1a730b05ab8881f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88818 expref: 13 pid: 5845 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586919.910910:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875469208134272:0@lo:104: 00010000:00010000:3.0:1788586919.910924:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.910932:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.910937:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586919.910942:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030000/0xc1a730b05ab888c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586919.922513:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:6703:x1875469208134144:12345-0@lo:253: Request processed in 63712us (63798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586919.922528:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586919.922757:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:6703:1875469208134144:0@lo:253: 10000000:01000000:0.0:1788586919.922773:0:6703:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788586919.922777:0:6703:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788586919.922778:0:6703:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788586919.922780:0:6703:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788586919.922781:0:6703:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788586919.922782:0:6703:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788586919.922784:0:6703:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788586919.922785:0:6703:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788586919.922786:0:6703:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788586919.922788:0:6703:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788586919.922789:0:6703:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788586919.922791:0:6703:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788586919.922813:0:6703:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788586919.928558:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586919.928836:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788586919.929234:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586919.929395:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788586919.929751:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788586919.930119:0:6703:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788586919.931521:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788586920.248726:0:6703:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788586920.248733:0:6703:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788586920.248769:0:6703:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788586920.248833:0:6703:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788586920.248882:0:6703:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788586920.248912:0:6703:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788586920.643139:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586921.673911:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586922.694670:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586923.724502:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586924.739594:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586925.059931:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586925.059968:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208134784:0@lo:400: 00000100:00100000:2.0:1788586925.060059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586925.060138:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134784 00000100:00100000:2.0:1788586925.060146:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134784 00000100:00100000:2.0:1788586925.060212:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788586925.060223:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208134784:12345-0@lo:400: 00000100:00100000:2.0:1788586925.060278:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5944e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208134784:12345-0@lo:400: Request processed in 57us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586925.060285:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788586925.060346:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5947b80 x1875469208134784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586925.060361:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208134784:0@lo:400: 00000100:00100000:1.0:1788586925.060585:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208134656:0@lo:400: 00000100:00100000:1.0:1788586925.060617:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586925.060647:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788586925.060653:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208134528:0@lo:400: 00000100:00100000:1.0:1788586925.060681:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586925.060710:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134528 00000100:00100000:1.0:1788586925.060714:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134528 00000100:00100000:1.0:1788586925.060746:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788586925.060754:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3315:x1875469208134528:12345-0@lo:400: 00000100:00100000:1.0:1788586925.060801:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3315:x1875469208134528:12345-0@lo:400: Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586925.060808:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788586925.060836:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208134528:0@lo:400: 00000100:00100000:2.0:1788586925.060924:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134656 00000100:00100000:2.0:1788586925.060928:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134656 00000100:00100000:2.0:1788586925.060961:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788586925.060967:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208134656:12345-0@lo:400: 00000100:00100000:2.0:1788586925.061004:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208134656:12345-0@lo:400: Request processed in 37us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586925.061010:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788586925.061036:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5947100 x1875469208134656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586925.061046:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208134656:0@lo:400: 00000100:00080000:3.0:1788586925.061125:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788586925.764948:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586926.787892:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586927.813367:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586928.220530:0:7069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788586928.838244:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788586929.673416:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788586929.673424:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bac83941800 from 21 10000000:01000000:3.0:1788586929.674532:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586929.674595:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.674608:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.674619:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.674649:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208134912:0@lo:101: 00000100:00100000:3.0:1788586929.674737:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.675613:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788586929.678612:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208134912 00000100:00100000:0.0:1788586929.678629:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208134912 00000100:00100000:0.0:1788586929.678716:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788586929.678729:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208134912:12345-0@lo:101: 00010000:00010000:0.0:1788586929.678745:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586929.678767:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab888c7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586929.678797:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586929.678809:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586929.678819:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80030400, rc 0) 00000100:00100000:0.0:1788586929.679104:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208134912:12345-0@lo:101: Request processed in 377us (4366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586929.679111:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788586929.679212:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208134912:0@lo:101: 00010000:00010000:3.0:1788586929.679232:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.679243:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.679317:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135040:0@lo:501: 00000100:00100000:3.0:1788586929.679352:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.679407:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ecf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788586929.679633:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135040 00000100:00100000:0.0:1788586929.679639:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135040 00000100:00100000:0.0:1788586929.679686:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788586929.679694:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208135040:12345-0@lo:501: 00000100:00100000:0.0:1788586929.680095:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208135040:12345-0@lo:501: Request processed in 400us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586929.680102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788586929.680204:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135040:0@lo:501: 00000100:00100000:3.0:1788586929.680237:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135168:0@lo:503: 00000100:00100000:3.0:1788586929.680278:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.680310:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788586929.680448:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135168 00000100:00100000:1.0:1788586929.680454:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135168 00000100:00100000:1.0:1788586929.680497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788586929.680505:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208135168:12345-0@lo:503: 00000100:00100000:1.0:1788586929.680812:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208135168:12345-0@lo:503: Request processed in 307us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586929.680819:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788586929.680885:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135168:0@lo:503: 00000100:00100000:1.0:1788586929.681082:0:7139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7139:1875469208135296:0@lo:502: 00000100:00100000:1.0:1788586929.681119:0:7139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586929.681142:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135296 00000100:00100000:1.0:1788586929.681146:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135296 00000100:00100000:1.0:1788586929.681166:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788586929.681381:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7139:x1875469208135296:12345-0@lo:502: 00000100:00100000:1.0:1788586929.681656:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7139:x1875469208135296:12345-0@lo:502: Request processed in 482us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586929.681663:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788586929.681706:0:7139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac89124d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586929.681720:0:7139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7139:1875469208135296:0@lo:502: 00000100:00100000:1.0:1788586929.681763:0:7139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7139:1875469208135424:0@lo:502: 00000100:00100000:1.0:1788586929.681796:0:7139:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586929.681931:0:7139:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac89124d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586929.689068:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135424 00000100:00100000:3.0:1788586929.689087:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135424 00000100:00100000:3.0:1788586929.689176:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788586929.689188:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7139:x1875469208135424:12345-0@lo:502: 00000100:00100000:3.0:1788586929.689500:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7139:x1875469208135424:12345-0@lo:502: Request processed in 313us (7702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.689508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788586929.690427:0:7139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7139:1875469208135424:0@lo:502: 00000040:00080000:0.0:1788586929.690482:0:7139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788586929.690745:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788586929.690766:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586929.690777:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.690789:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586929.690798:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788586929.690801:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac83941800 from 4 10000000:01000000:3.0:1788586929.690804:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788586929.690865:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.690874:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.690894:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.690913:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135552:0@lo:101: 00000100:00100000:3.0:1788586929.690963:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.690999:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9eccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586929.691210:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135552 00000100:00100000:0.0:1788586929.691216:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135552 00000100:00100000:0.0:1788586929.691266:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788586929.691275:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208135552:12345-0@lo:101: 00010000:00010000:0.0:1788586929.691287:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586929.691302:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab888d5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586929.691322:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586929.691333:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586929.691342:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80030e00, rc 0) 00000100:00100000:0.0:1788586929.691382:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208135552:12345-0@lo:101: Request processed in 108us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586929.691387:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788586929.691467:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135552:0@lo:101: 00010000:00010000:3.0:1788586929.691482:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.691491:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.691538:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135680:0@lo:256: 00000100:00100000:3.0:1788586929.691568:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.691594:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586929.691609:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135680 00000100:00100000:3.0:1788586929.691612:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135680 00000100:00100000:3.0:1788586929.691638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788586929.691644:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208135680:12345-0@lo:256: 20000000:01000000:3.0:1788586929.691659:0:5845:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788586929.691688:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788586929.691692:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788586929.691770:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208135680:12345-0@lo:256: Request processed in 126us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.691778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788586929.691812:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135680:0@lo:256: 10000000:01000000:3.0:1788586929.691882:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788586929.691888:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.691896:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586929.691903:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788586929.691905:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788586929.691908:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586929.691924:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.691931:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.691938:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.691949:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135808:0@lo:101: 00000100:00100000:3.0:1788586929.691972:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.691986:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586929.691997:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135808 00000100:00100000:3.0:1788586929.692000:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135808 00000100:00100000:3.0:1788586929.692017:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788586929.692022:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208135808:12345-0@lo:101: 00010000:00010000:3.0:1788586929.692029:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586929.692038:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab888e3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.692059:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.692067:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.692074:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4a00, rc 0) 00000100:00100000:3.0:1788586929.692102:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208135808:12345-0@lo:101: Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.692107:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788586929.692134:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135808:0@lo:101: 00010000:00010000:3.0:1788586929.692143:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.692150:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.692191:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135936:0@lo:501: 00000100:00100000:3.0:1788586929.692217:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.692229:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586929.692238:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208135936 00000100:00100000:3.0:1788586929.692242:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208135936 00000100:00100000:3.0:1788586929.692257:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788586929.692263:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208135936:12345-0@lo:501: 00000100:00100000:3.0:1788586929.692525:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208135936:12345-0@lo:501: Request processed in 261us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.692532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788586929.692567:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208135936:0@lo:501: 00000100:00100000:3.0:1788586929.692594:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208136064:0@lo:503: 00000100:00100000:3.0:1788586929.692630:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.692644:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9eccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586929.692655:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136064 00000100:00100000:3.0:1788586929.692659:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136064 00000100:00100000:3.0:1788586929.692692:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788586929.692699:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208136064:12345-0@lo:503: 00000100:00100000:3.0:1788586929.693005:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208136064:12345-0@lo:503: Request processed in 306us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.693011:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788586929.693049:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208136064:0@lo:503: 00000100:00100000:3.0:1788586929.693235:0:7140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7140:1875469208136192:0@lo:502: 00000100:00100000:3.0:1788586929.693269:0:7140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.693287:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136192 00000100:00100000:3.0:1788586929.693291:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136192 00000100:00100000:3.0:1788586929.693313:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788586929.693319:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7140:x1875469208136192:12345-0@lo:502: 00000100:00100000:3.0:1788586929.693510:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7140:x1875469208136192:12345-0@lo:502: Request processed in 190us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.693516:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788586929.693543:0:7140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ecc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788586929.693555:0:7140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7140:1875469208136192:0@lo:502: 00000020:01000000:3.0:1788586929.693577:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788586929.693585:0:7140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788586929.693592:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586929.693601:0:7140:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788586929.693607:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788586929.693611:0:7140:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:3.0:1788586929.693633:0:7140:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788586929.693635:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788586929.693649:0:7140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8bacae3ab380) 00000020:00000080:3.0:1788586929.693667:0:7140:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788586929.693689:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788586929.693773:0:7140:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788586929.693779:0:7140:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788586929.693787:0:7140:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab888f8 00010000:00080000:3.0:1788586929.693817:0:7140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bac903c1800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:3.0:1788586929.694047:0:7140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788586929.787941:0:7140:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788586929.787968:0:7140:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788586929.789247:0:7140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586929.789921:0:7140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586929.789981:0:7140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788586929.790048:0:7140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788586929.790452:0:7143:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788586929.790458:0:7143:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788586929.793134:0:7140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788586929.793150:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788586929.793195:0:7140:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788586929.793224:0:7140:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab888ff 00000100:00080000:2.0:1788586929.793239:0:7140:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788586929.793247:0:7140:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bac903c1800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1788586929.793452:0:7140:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacb5947100 x1875469208136320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788586929.793495:0:7140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788586929.793578:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586929.793583:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586929.793585:0:7140:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788586929.793603:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586929.793608:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586929.793609:0:7140:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788586929.793612:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788586929.793614:0:7140:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788586929.793644:0:7140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7140:1875469208136576:0@lo:502: 00000100:00100000:2.0:1788586929.793754:0:7140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586929.793803:0:7140:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac982743c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586929.793825:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208136448:0@lo:400: 00000100:00100000:2.0:1788586929.793884:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586929.793913:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788586929.793921:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208136704:0@lo:400: 00000100:00100000:2.0:1788586929.793944:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586929.793972:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136576 00000100:00100000:2.0:1788586929.793979:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136576 00000100:00100000:2.0:1788586929.794019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788586929.794029:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7140:x1875469208136576:12345-0@lo:502: 00000100:00100000:2.0:1788586929.794273:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7140:x1875469208136576:12345-0@lo:502: Request processed in 244us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.794464:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208136320:0@lo:8: 00000100:00100000:3.0:1788586929.794514:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586929.794622:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136320 00000100:00100000:1.0:1788586929.794627:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136320 00000100:00100000:1.0:1788586929.794660:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788586929.794665:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875469208136320:12345-0@lo:8: 00010000:00080000:1.0:1788586929.794698:0:6706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:1.0:1788586929.794742:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab88906 00002000:00100000:1.0:1788586929.794779:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8bacbf519000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788586929.794784:0:6706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788586929.794789:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788586929.794949:0:6706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788586929.795101:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788586929.795139:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8bacbf51f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788586929.795191:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875469208136320:12345-0@lo:8: Request processed in 523us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586929.795198:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788586929.795658:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5947100 x1875469208136320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788586939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586929.795679:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788586929.795690:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788586929.795701:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788586929.795706:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788586929.795709:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bac903c1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788586929.795732:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788586929.795739:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208136320:0@lo:8: 00000100:00100000:3.0:1788586929.795876:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136448 00000100:00100000:3.0:1788586929.795882:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136448 00000100:00100000:3.0:1788586929.795918:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136704 00000100:00100000:3.0:1788586929.795920:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136704 00000100:00100000:3.0:1788586929.795949:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788586929.795967:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208136448:12345-0@lo:400: 00000100:00100000:3.0:1788586929.796022:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208136448:12345-0@lo:400: Request processed in 55us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.796029:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788586929.796044:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586929.796050:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208136704:12345-0@lo:400: 00000100:00100000:3.0:1788586929.796084:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5944000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208136704:12345-0@lo:400: Request processed in 36us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.796091:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788586929.796114:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586929.796176:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788586929.796241:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbccb100 x1875469208136704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586929.796253:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208136704:0@lo:400: 00010000:00080000:2.0:1788586929.796351:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbcc9500 x1875469208136448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586929.796362:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208136448:0@lo:400: 00000100:00100000:2.0:1788586929.796391:0:7140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7140:1875469208136576:0@lo:502: 00000020:01000000:2.0:1788586929.796433:0:7140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586929.796441:0:7140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586929.796443:0:7140:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788586929.796448:0:7140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788586929.796662:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788586929.796694:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788586929.796705:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.799031:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586929.799058:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788586929.799061:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bac912719c0 from 1 10000000:01000000:3.0:1788586929.799065:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788586929.799114:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.799122:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.799134:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.799169:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208136832:0@lo:101: 00000100:00100000:3.0:1788586929.799236:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.799277:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ecf00 going to sleep for 11 seconds 00000004:00080000:2.0:1788586929.801195:0:7143:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788586929.801445:0:7143:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 252005601475ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788586929.803006:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136832 00000100:00100000:1.0:1788586929.803024:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136832 00000100:00100000:1.0:1788586929.803089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788586929.803101:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208136832:12345-0@lo:101: 00010000:00010000:1.0:1788586929.803123:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586929.803143:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab8890d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586929.803172:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586929.803182:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586929.803191:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051c00, rc 0) 00000100:00100000:1.0:1788586929.803273:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208136832:12345-0@lo:101: Request processed in 175us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586929.803279:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788586929.805323:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208136832:0@lo:101: 00010000:00010000:3.0:1788586929.805364:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.805377:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586929.805457:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208136960:0@lo:501: 00000100:00100000:3.0:1788586929.805514:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.805549:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788586929.808278:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208136960 00000100:00100000:3.0:1788586929.808297:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208136960 00000100:00100000:3.0:1788586929.808351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788586929.808361:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208136960:12345-0@lo:501: 00000100:00100000:3.0:1788586929.808942:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208136960:12345-0@lo:501: Request processed in 580us (3426us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788586929.808950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788586929.809009:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208136960:0@lo:501: 10000000:01000000:3.0:1788586929.809053:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788586929.809065:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586929.809076:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788586929.835273:0:7144:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788586929.835304:0:7144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137216:0@lo:7: 00000100:00100000:2.0:1788586929.835534:0:7144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586929.835678:0:7144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586929.835801:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208137088:0@lo:13: 00000100:00100000:2.0:1788586929.835833:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586929.835903:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137216 00000100:00100000:2.0:1788586929.835910:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137216 00000100:00100000:2.0:1788586929.835967:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586929.835977:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7144:x1875469208137216:12345-0@lo:7: 00000100:00080000:0.0:1788586929.837980:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788586929.837981:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137088 00000100:00100000:3.0:1788586929.837991:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137088 00000100:00100000:3.0:1788586929.838045:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586929.838055:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208137088:12345-0@lo:13: 00002000:00000024:3.0:1788586929.838083:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788586929.838162:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208137088:12345-0@lo:13: Request processed in 108us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586929.838170:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788586929.842987:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5947b80 x1875469208137088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586929.843016:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208137088:0@lo:13: 00002000:00080000:2.0:1788586929.844450:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788586929.844458:0:6708:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788586929.844558:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7144:x1875469208137216:12345-0@lo:7: Request processed in 8579us (9021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586929.844569:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788586929.844734:0:7144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5946300 x1875469208137216/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788586945 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586929.844747:0:7144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137216:0@lo:7: 00000004:00080000:3.0:1788586929.844761:0:7144:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788586929.844805:0:7144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137344:0@lo:5: 00000100:00100000:3.0:1788586929.844889:0:7144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.844927:0:7144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baca7834540 going to sleep for 11 seconds 00000100:00100000:2.0:1788586929.845837:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137344 00000100:00100000:2.0:1788586929.845875:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137344 00000100:00100000:2.0:1788586929.845921:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788586929.845932:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7144:x1875469208137344:12345-0@lo:5: 00002000:00080000:2.0:1788586929.845964:0:6707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788586929.845968:0:6707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788586929.846275:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7144:x1875469208137344:12345-0@lo:5: Request processed in 344us (1384us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788586929.846288:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788586929.846479:0:7144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb44f9c00 x1875469208137344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586945 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586929.846495:0:7144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137344:0@lo:5: 00000004:00080000:3.0:1788586929.846507:0:7144:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788586929.846541:0:7144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137472:0@lo:700: 00000100:00100000:3.0:1788586929.846582:0:7144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586929.846609:0:7144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baca7834540 going to sleep for 11 seconds 00000100:00100000:2.0:1788586929.846687:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137472 00000100:00100000:2.0:1788586929.846692:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137472 00000100:00100000:2.0:1788586929.846801:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788586929.846811:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7144:x1875469208137472:12345-0@lo:700: 00000100:00100000:2.0:1788586929.846877:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1875469208137600:0@lo:700: 00000100:00100000:2.0:1788586929.846905:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586929.846924:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586929.846968:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137600 00000100:00100000:0.0:1788586929.846973:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137600 00000100:00100000:0.0:1788586929.847009:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788586929.847017:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1875469208137600:12345-0@lo:700: 00010000:00010000:0.0:1788586929.859827:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788586929.874174:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788586929.897545:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788586929.903351:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1875469208137600:12345-0@lo:700: Request processed in 56327us (56436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586929.903373:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788586929.903531:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5947480 x1875469208137600/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788586945 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586929.903548:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1875469208137600:0@lo:700: 40000000:02000000:0.0:1788586929.903569:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1788586929.962445:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788586929.962468:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:2.0:1788586929.962692:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7144:x1875469208137472:12345-0@lo:700: Request processed in 115877us (116103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586929.962703:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788586929.962793:0:7144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb44fa300 x1875469208137472/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788586945 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586929.962804:0:7144:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788586929.962821:0:7144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137472:0@lo:700: 00000004:02000040:3.0:1788586930.007098:0:7144:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788586930.015931:0:7144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137728:0@lo:5: 00000100:00100000:3.0:1788586930.016014:0:7144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586930.016068:0:7144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788586930.016096:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137728 00000100:00100000:3.0:1788586930.016105:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137728 00000100:00100000:3.0:1788586930.016160:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586930.016170:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7144:x1875469208137728:12345-0@lo:5: 00002000:00080000:3.0:1788586930.028642:0:6708:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788586930.028676:0:6708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788586930.036601:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7144:x1875469208137728:12345-0@lo:5: Request processed in 20420us (20574us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788586930.036630:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788586930.040755:0:7144:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb44fa300 x1875469208137728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586946 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586930.040784:0:7144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7144:1875469208137728:0@lo:5: 00000004:00080000:3.0:1788586930.040815:0:7144:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788586930.887011:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586931.908743:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586932.932054:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788586933.813581:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788586933.963649:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586934.985653:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586935.299361:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208138112:0@lo:400: 00000100:00100000:2.0:1788586935.299368:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208137856:0@lo:400: 00000100:00100000:3.0:1788586935.299611:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208138240:0@lo:400: 00000100:00100000:2.0:1788586935.299749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586935.299749:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586935.299817:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208138368:0@lo:13: 00000100:00100000:2.0:1788586935.299886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586935.299889:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586935.299905:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586935.299910:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208137984:0@lo:400: 00000100:00100000:3.0:1788586935.299919:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208138240 00000100:00100000:3.0:1788586935.299934:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208138240 00000100:00100000:3.0:1788586935.299995:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586935.300004:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208138240:12345-0@lo:400: 00000100:00100000:3.0:1788586935.300056:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208138240:12345-0@lo:400: Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586935.300063:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788586935.300280:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788586935.300315:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5947800 x1875469208138240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586935.300325:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788586935.300343:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208138240:0@lo:400: 00000100:00100000:2.0:1788586935.300718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586935.300767:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208138112 00000100:00100000:2.0:1788586935.300772:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208138112 00000100:00100000:2.0:1788586935.300816:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137984 00000100:00100000:2.0:1788586935.300819:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137984 00000100:00100000:2.0:1788586935.300835:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586935.301065:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208138112:12345-0@lo:400: 00000100:00100000:2.0:1788586935.301116:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208138112:12345-0@lo:400: Request processed in 274us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586935.301123:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586935.301138:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586935.301144:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208137984:12345-0@lo:400: 00000100:00100000:2.0:1788586935.301433:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208137984:12345-0@lo:400: Request processed in 288us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586935.301440:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788586935.301458:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788586935.301743:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5945500 x1875469208137984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586935.301756:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208137984:0@lo:400: 00010000:00080000:2.0:1788586935.301788:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb5946a00 x1875469208138112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586935.301798:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208138112:0@lo:400: 00000100:00100000:0.0:1788586935.303051:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208138368 00000100:00100000:0.0:1788586935.303062:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208138368 00000100:00100000:0.0:1788586935.303110:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788586935.303125:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208138368:12345-0@lo:13: 00002000:00000024:0.0:1788586935.303172:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788586935.303241:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208138368:12345-0@lo:13: Request processed in 122us (3354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586935.305011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208137856 00000100:00100000:1.0:1788586935.305026:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208137856 00000100:00100000:1.0:1788586935.305089:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788586935.305098:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3312:x1875469208137856:12345-0@lo:400: 00000100:00100000:1.0:1788586935.305182:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3312:x1875469208137856:12345-0@lo:400: Request processed in 86us (5435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586935.305196:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788586935.305922:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbccbb80 x1875469208138368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586935.305945:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208138368:0@lo:13: 00000100:00100000:1.0:1788586935.305957:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208137856:0@lo:400: 00000100:00100000:0.0:1788586935.307272:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788586936.003628:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586937.035868:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586938.051310:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586939.075425:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586940.102352:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586940.421571:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586940.421602:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208138496:0@lo:13: 00000100:00100000:1.0:1788586940.421681:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586940.422969:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208138496 00000100:00100000:3.0:1788586940.422983:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208138496 00000100:00100000:3.0:1788586940.423059:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788586940.423070:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208138496:12345-0@lo:13: 00002000:00000024:3.0:1788586940.423108:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788586940.423173:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208138496:12345-0@lo:13: Request processed in 105us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586940.423180:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788586940.424681:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788586940.424753:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbccbb80 x1875469208138496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586940.424784:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208138496:0@lo:13: 00000100:00100000:3.0:1788586940.431384:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208138624:0@lo:400: 00000100:00100000:3.0:1788586940.431477:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586940.431524:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788586940.434125:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208138752:0@lo:400: 00000100:00100000:3.0:1788586940.434209:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586940.434279:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586940.434295:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208138880:0@lo:400: 00000100:00100000:3.0:1788586940.434323:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586940.434353:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208138624 00000100:00100000:3.0:1788586940.434362:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208138624 00000100:00100000:3.0:1788586940.434412:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788586940.434421:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3314:x1875469208138624:12345-0@lo:400: 00000100:00100000:3.0:1788586940.434486:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3314:x1875469208138624:12345-0@lo:400: Request processed in 65us (3020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586940.434493:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788586940.434527:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208138752 00000100:00100000:3.0:1788586940.434531:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208138752 00000100:00100000:3.0:1788586940.434551:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208138880 00000100:00100000:3.0:1788586940.434554:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208138880 00000100:00100000:3.0:1788586940.434577:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586940.434583:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208138752:12345-0@lo:400: 00000100:00100000:3.0:1788586940.434612:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208138752:12345-0@lo:400: Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586940.434618:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788586940.434630:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788586940.434636:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208138880:12345-0@lo:400: 00000100:00100000:3.0:1788586940.434666:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208138880:12345-0@lo:400: Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586940.434672:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788586940.434710:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb44fa680 x1875469208138752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586940.441913:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208138752:0@lo:400: 00000100:00100000:3.0:1788586940.441945:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208138624:0@lo:400: 00000100:00080000:3.0:1788586940.441995:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788586940.442026:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacb44fb480 x1875469208138880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586940.442036:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208138880:0@lo:400: 00010000:00010000:1.0:1788586941.125371:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586942.152994:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586943.171937:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788586943.575809:0:7649:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788586943.575814:0:7649:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788586943.576061:0:7649:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bacbb896000 00000020:01000004:2.0:1788586943.576081:0:7649:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788586943.576095:0:7649:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788586943.576109:0:7649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8bac883519c0) 00000020:00000080:2.0:1788586943.576125:0:7649:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788586943.654660:0:7649:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788586943.654944:0:7649:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788586943.779127:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788586943.798445:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788586943.798485:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788586943.798555:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788586943.798585:0:7649:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788586943.799020:0:7649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788586943.799032:0:7649:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788586943.799042:0:7649:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1a730b05ab88922 00000020:01000004:2.0:1788586943.799049:0:7649:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788586943.799072:0:7649:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788586943.799077:0:7649:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788586943.799082:0:7649:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788586943.799106:0:7649:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788586943.799111:0:7649:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788586943.893736:0:7649:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788586943.893795:0:7649:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.128@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788586943.893799:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788586943.893802:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788586943.893803:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586943.893804:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788586943.893806:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586943.893807:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586943.893808:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788586943.893810:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788586943.893812:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788586943.893814:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586943.893815:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788586943.893820:0:7649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788586943.893822:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788586943.893827:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788586943.893828:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586943.893829:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788586943.893830:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586943.893830:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586943.893831:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788586943.893832:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788586943.893833:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788586943.893834:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586943.893834:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788586943.894330:0:7649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788586943.894352:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208139008:0@lo:253: 00000100:00100000:1.0:1788586943.896451:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.896589:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1788586943.902619:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139008 00000100:00100000:2.0:1788586943.902638:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139008 00000100:00100000:2.0:1788586943.902775:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788586943.902789:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:7649:x1875469208139008:12345-0@lo:253: 20000000:01000000:2.0:1788586943.902833:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788586943.902839:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788586943.902860:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788586943.902864:0:5845:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788586943.903925:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788586943.904151:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788586943.904166:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788586943.904206:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788586943.904215:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788586943.904246:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788586943.904295:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788586943.904700:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788586943.904727:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:2.0:1788586943.904730:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:2.0:1788586943.904769:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788586943.904777:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788586943.904838:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788586943.904880:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:2.0:1788586943.904913:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788586943.904923:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788586943.904952:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788586943.905001:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788586943.912664:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788586943.912693:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.128@tcp 20000000:01000000:0.0:1788586943.912695:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.128@tcp (null) (null) (null) 00000040:00080000:0.0:1788586943.912727:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788586943.912734:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788586943.912758:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788586943.912764:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.128@tcp (null) (null) 00000040:00080000:0.0:1788586943.912786:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788586943.912794:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788586943.912829:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788586943.912908:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788586943.912924:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788586943.912927:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788586943.912931:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788586943.912945:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788586943.912948:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788586943.912982:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788586943.912985:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788586943.917781:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788586943.917927:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788586943.920667:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788586943.921156:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788586943.921196:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788586943.921286:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788586943.921298:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788586943.921301:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788586943.922477:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788586943.922811:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788586943.922901:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788586943.923070:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788586943.923084:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788586943.923086:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788586943.926111:0:7653:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788586943.926214:0:7653:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788586943.926515:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788586943.927149:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788586943.927210:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788586943.927678:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1788586943.927694:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788586943.927697:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788586943.931123:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788586943.931518:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788586943.931566:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788586943.932056:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788586943.932103:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788586943.932461:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788586943.932483:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788586943.932486:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788586943.932495:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788586943.932516:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932602:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932613:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932633:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932640:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932647:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932654:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932700:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932718:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 16 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586943.932735:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139136:0@lo:104: 00000100:00100000:1.0:1788586943.932807:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788586943.932900:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.932908:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 16 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586943.932916:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139264:0@lo:104: 00010000:00010000:1.0:1788586943.932940:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586943.933098:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788586943.933118:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586943.933141:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139136 00000100:00100000:3.0:1788586943.933149:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139136 00000100:00100000:3.0:1788586943.933199:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139264 00000100:00100000:3.0:1788586943.933203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139264 00000100:00100000:3.0:1788586943.933217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586943.933238:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:5845:x1875469208139136:12345-0@lo:104: 00010000:00010000:3.0:1788586943.933250:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933299:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788586943.933306:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9128ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:5845:x1875469208139136:12345-0@lo:104: Request processed in 70us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586943.933313:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586943.933348:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586943.933356:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208139264:12345-0@lo:104: 00010000:00010000:3.0:1788586943.933363:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933417:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788586943.933423:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208139264:12345-0@lo:104: Request processed in 69us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586943.933429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788586943.933448:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788586943.933454:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933460:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4400 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788586943.933463:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933473:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586943.933480:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586943.933485:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586943.933516:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933522:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586943.933549:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933556:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c4400/0xc1a730b05ab8890d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88914 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933588:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788586943.933591:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933596:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5e00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788586943.933599:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933605:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788586943.933611:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586943.933616:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788586943.933629:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933634:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788586943.933646:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933652:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab888e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888ea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.933661:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586943.933663:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586943.933664:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586943.933670:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586943.933695:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208139520:0@lo:103: 00000100:00100000:3.0:1788586943.933722:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586943.933764:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208139648:0@lo:103: 00000100:00100000:3.0:1788586943.933785:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586943.933827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139520 00000100:00100000:3.0:1788586943.933830:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139520 00010000:00010000:3.0:1788586943.933888:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 17 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586943.933909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139648 00000100:00100000:3.0:1788586943.933912:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139648 00010000:00010000:3.0:1788586943.933922:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 18 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586943.933934:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586943.933953:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3313:x1875469208139520:12345-0@lo:103: 00010000:00010000:3.0:1788586943.933963:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586943.933970:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 18 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.938896:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 18 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586943.938915:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139392:0@lo:104: 00000100:00100000:1.0:1788586943.939004:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788586943.939119:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 18 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.939147:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586943.939202:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3313:x1875469208139520:12345-0@lo:103: Request processed in 5261us (5478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586943.939212:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586943.939531:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586943.939557:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3314:x1875469208139648:12345-0@lo:103: 00010000:00010000:3.0:1788586943.939585:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788586943.939593:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 17 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.939603:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 17 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.939614:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586943.939647:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3314:x1875469208139648:12345-0@lo:103: Request processed in 97us (5860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586943.939653:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788586943.939716:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208139648:0@lo:103: 00000100:00100000:3.0:1788586943.939750:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208139520:0@lo:103: 00010000:00010000:1.0:1788586943.940363:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.940375:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 16 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586943.940386:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139776:0@lo:104: 00000100:00100000:1.0:1788586943.940441:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788586943.940485:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.940493:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 16 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586943.940501:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139904:0@lo:104: 00000100:00100000:0.0:1788586943.941425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139392 00000100:00100000:0.0:1788586943.941436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139392 00000100:00100000:0.0:1788586943.941483:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139776 00000100:00100000:0.0:1788586943.941486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139776 00000100:00100000:0.0:1788586943.941500:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788586943.941508:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:5845:x1875469208139392:12345-0@lo:104: 00010000:00010000:0.0:1788586943.941526:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586943.941603:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586943.941617:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:5845:x1875469208139392:12345-0@lo:104: Request processed in 110us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.941625:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788586943.941641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788586943.941648:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208139776:12345-0@lo:104: 00010000:00010000:0.0:1788586943.941656:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586943.941687:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788586943.941691:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208139776:12345-0@lo:104: Request processed in 45us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586943.941696:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788586943.942695:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586943.942735:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c36c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788586943.942764:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2051c00/0xc1a730b05ab88914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab8890d expref: 16 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586943.942783:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139136:0@lo:104: 00010000:00010000:1.0:1788586943.942795:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4a00/0xc1a730b05ab888ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab888e3 expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586943.942820:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139264:0@lo:104: 00000100:00100000:1.0:1788586943.942831:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139392:0@lo:104: 00000100:00100000:1.0:1788586943.942838:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139776:0@lo:104: 00000100:00100000:3.0:1788586943.943523:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208139904 00000100:00100000:3.0:1788586943.943533:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208139904 00000100:00100000:3.0:1788586943.943772:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788586943.943783:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208139904:12345-0@lo:104: 00010000:00010000:3.0:1788586943.943799:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586943.943891:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788586943.943897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5845:x1875469208139904:12345-0@lo:104: Request processed in 117us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586943.943905:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788586943.943996:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5845:1875469208139904:0@lo:104: 00010000:00010000:1.0:1788586943.944031:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947196:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788586943.947214:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947239:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5600 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586943.947244:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947256:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586943.947264:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586943.947270:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586943.947350:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947372:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586943.947410:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947418:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5600/0xc1a730b05ab888c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888ce expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947432:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586943.947436:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947442:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac80030600 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586943.947445:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947452:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586943.947459:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586943.947464:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586943.947477:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947483:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586943.947497:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947503:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac80030600/0xc1a730b05ab8889d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888a4 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947520:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586943.947523:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947529:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586943.947531:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947548:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586943.947554:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586943.947559:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586943.947575:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947587:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586943.947593:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947600:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88873 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8887a expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.947615:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586943.947617:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586943.947619:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586943.947652:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208140032:0@lo:103: 00000100:00100000:2.0:1788586943.947728:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586943.947782:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586943.947799:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208140160:0@lo:103: 00000100:00100000:2.0:1788586943.947818:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586943.947832:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586943.947837:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208140288:0@lo:103: 00000100:00100000:2.0:1788586943.947884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586943.947924:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140032 00000100:00100000:2.0:1788586943.947931:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140032 00010000:00010000:2.0:1788586943.947956:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 15 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586943.947974:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140160 00000100:00100000:2.0:1788586943.947976:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140160 00010000:00010000:2.0:1788586943.947985:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 16 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586943.947994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140288 00000100:00100000:2.0:1788586943.947996:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140288 00010000:00010000:2.0:1788586943.948003:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 17 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586943.948016:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586943.948022:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3315:x1875469208140032:12345-0@lo:103: 00010000:00010000:2.0:1788586943.948035:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586943.948040:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 17 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948051:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 17 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948071:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030400/0xc1a730b05ab888ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab888c7 expref: 17 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948085:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586943.948119:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3315:x1875469208140032:12345-0@lo:103: Request processed in 97us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586943.948127:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586943.948144:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586943.948150:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:3312:x1875469208140160:12345-0@lo:103: 00010000:00010000:2.0:1788586943.948157:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586943.948161:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948169:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948179:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2051400/0xc1a730b05ab888a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab8889d expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948189:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586943.948214:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3312:x1875469208140160:12345-0@lo:103: Request processed in 64us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586943.948219:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586943.948230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586943.948235:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3312:x1875469208140288:12345-0@lo:103: 00010000:00010000:2.0:1788586943.948242:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586943.948246:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 13 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948260:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 13 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948269:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab8887a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88873 expref: 13 pid: 5844 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948283:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948291:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948305:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948312:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948319:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948326:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948331:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788586943.948335:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948344:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948366:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586943.948376:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586943.948410:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3312:x1875469208140288:12345-0@lo:103: Request processed in 162us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586943.948417:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788586943.948457:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208140288:0@lo:103: 00000100:00100000:2.0:1788586943.948464:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208140160:0@lo:103: 00000100:00100000:2.0:1788586943.948492:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208140032:0@lo:103: 00010000:00010000:1.0:1788586943.949675:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.949690:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586943.949696:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88929 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788586943.949710:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788586944.082900:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:7649:x1875469208139008:12345-0@lo:253: Request processed in 180107us (186448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.082916:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788586944.083311:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208139008:0@lo:253: 10000000:01000000:1.0:1788586944.083328:0:7649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788586944.083331:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788586944.083333:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788586944.083334:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788586944.083335:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788586944.083336:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788586944.083337:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788586944.083339:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788586944.083340:0:7649:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788586944.083342:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788586944.083343:0:7649:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788586944.083377:0:7649:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bacbb896000 from lustre-OST0001 10000000:01000000:1.0:1788586944.083415:0:7649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788586944.083418:0:7649:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788586944.083425:0:7649:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bac912719c0 local copy 10000000:01000000:1.0:1788586944.083429:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788586944.083465:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.083476:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.083486:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586944.083504:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140416:0@lo:101: 00000100:00100000:1.0:1788586944.083543:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.083594:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586944.083656:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140416 00000100:00100000:0.0:1788586944.083662:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140416 00000100:00100000:0.0:1788586944.083707:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788586944.083716:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+11:7649:x1875469208140416:12345-0@lo:101: 00010000:00010000:0.0:1788586944.083728:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586944.083742:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88930 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.083768:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88930 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.083780:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88930 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.083801:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80030400, rc 0) 00000100:00100000:0.0:1788586944.083839:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208140416:12345-0@lo:101: Request processed in 125us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.083860:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788586944.083930:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140416:0@lo:101: 00010000:00010000:1.0:1788586944.083957:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.083966:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586944.084066:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140544:0@lo:501: 00000100:00100000:1.0:1788586944.084091:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.084114:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586944.084302:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140544 00000100:00100000:0.0:1788586944.084307:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140544 00000100:00100000:0.0:1788586944.084339:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788586944.084347:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208140544:12345-0@lo:501: 00000100:00100000:0.0:1788586944.084646:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208140544:12345-0@lo:501: Request processed in 299us (552us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788586944.084654:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788586944.084750:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140544:0@lo:501: 10000000:01000000:1.0:1788586944.084764:0:7649:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788586944.084800:0:7649:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788586944.084807:0:7649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.084815:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.084821:0:7649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.084872:0:7649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788586944.084893:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bacbb896000 10000000:01000000:1.0:1788586944.084899:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788586944.084905:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788586944.084907:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788586944.084911:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788586944.084914:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788586944.084935:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.085033:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586944.085041:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.085048:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050e00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586944.085052:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.085060:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586944.085067:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586944.085073:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586944.085096:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.085115:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586944.085145:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.085152:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc2050e00/0xc1a730b05ab88930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc1a730b05ab88937 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.085306:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.085318:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586944.085336:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140672:0@lo:101: 00000100:00100000:1.0:1788586944.085376:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.085414:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208140800:0@lo:103: 00000100:00100000:1.0:1788586944.085415:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788586944.085434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140672 00000100:00100000:1.0:1788586944.085445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140672 00000100:00100000:3.0:1788586944.085454:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.085478:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788586944.085487:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208140672:12345-0@lo:101: 00000100:00100000:3.0:1788586944.085489:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140800 00010000:00010000:1.0:1788586944.085497:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788586944.085499:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140800 00010000:00010000:1.0:1788586944.085510:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab8893e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586944.085530:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788586944.085536:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3314:x1875469208140800:12345-0@lo:103: 00010000:00010000:3.0:1788586944.085545:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586944.085548:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.085578:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586944.085580:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586944.085581:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586944.085686:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88930 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.085699:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586944.085738:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3314:x1875469208140800:12345-0@lo:103: Request processed in 202us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.085745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788586944.085793:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208140800:0@lo:103: 00010000:00010000:1.0:1788586944.085828:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.085836:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:1.0:1788586944.086363:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208140672:12345-0@lo:101: Request processed in 874us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.086371:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788586944.086468:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140672:0@lo:101: 00010000:00010000:2.0:1788586944.086483:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.086494:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586944.086788:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140928:0@lo:501: 00000100:00100000:2.0:1788586944.086817:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.086910:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98274480 going to sleep for 11 seconds 00000100:00100000:1.0:1788586944.086939:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208140928 00000100:00100000:1.0:1788586944.087085:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208140928 00000100:00100000:1.0:1788586944.087154:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788586944.087293:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208140928:12345-0@lo:501: 00000100:00100000:1.0:1788586944.087915:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208140928:12345-0@lo:501: Request processed in 625us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.087923:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788586944.089560:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208140928:0@lo:501: 00000100:00100000:2.0:1788586944.089623:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141056:0@lo:503: 00000100:00100000:2.0:1788586944.089707:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.089756:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98274480 going to sleep for 11 seconds 00000100:00100000:1.0:1788586944.089813:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141056 00000100:00100000:1.0:1788586944.089820:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141056 00000100:00100000:1.0:1788586944.089884:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788586944.089892:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208141056:12345-0@lo:503: 00000100:00100000:2.0:1788586944.092183:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141056:0@lo:503: 00000100:00100000:0.0:1788586944.092277:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208141056:12345-0@lo:503: Request processed in 2383us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.092289:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000040:00080000:2.0:1788586944.092744:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788586944.092826:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141184:0@lo:502: 00000100:00100000:2.0:1788586944.093027:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.093106:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98274480 going to sleep for 11 seconds 00000100:00100000:3.0:1788586944.093147:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141184 00000100:00100000:3.0:1788586944.093155:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141184 00000100:00100000:3.0:1788586944.093299:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788586944.093310:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208141184:12345-0@lo:502: 00000100:00100000:3.0:1788586944.093543:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208141184:12345-0@lo:502: Request processed in 228us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.093550:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788586944.093646:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141184:0@lo:502: 00000040:00080000:1.0:1788586944.094121:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788586944.094177:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788586944.094210:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788586944.094443:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788586944.094477:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788586944.094507:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788586944.094566:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141312:0@lo:502: 00000100:00100000:1.0:1788586944.094621:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.094661:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788586944.094669:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141312 00000100:00100000:0.0:1788586944.094676:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141312 00000100:00100000:0.0:1788586944.094762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788586944.094772:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208141312:12345-0@lo:502: 00000100:00100000:0.0:1788586944.094967:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208141312:12345-0@lo:502: Request processed in 195us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.094975:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788586944.095137:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141312:0@lo:502: 00000040:00080000:1.0:1788586944.095391:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788586944.095414:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788586944.096156:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788586944.096165:0:7655:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788586944.096171:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586944.096173:0:7655:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788586944.096178:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788586944.096203:0:7655:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8bacbbc28000) 00000020:00000080:1.0:1788586944.096297:0:7655:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788586944.096305:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788586944.096389:0:7655:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacbb896000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788586944.096406:0:7655:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788586944.096414:0:7655:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1a730b05ab88953 00010000:00010000:0.0:1788586944.100159:0:7655:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788586944.100638:0:7655:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788586944.104089:0:7655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788586944.104556:0:7655:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788586944.110094:0:7655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788586944.111664:0:7655:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788586944.113834:0:7655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788586944.113892:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586944.113899:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586944.113901:0:7655:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788586944.113905:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586944.113908:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586944.113910:0:7655:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788586944.113912:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586944.113914:0:7655:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788586944.113964:0:7655:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586944.113966:0:7655:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586944.113968:0:7655:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788586944.113971:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788586944.115753:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788586944.115798:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788586944.115833:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.115879:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586944.115902:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacbb896000 from 1 10000000:01000000:1.0:1788586944.115905:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788586944.116122:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.116132:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586944.116146:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586944.116376:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141440:0@lo:101: 00000100:00100000:1.0:1788586944.116458:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.116551:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788586944.122435:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141440 00000100:00100000:2.0:1788586944.122453:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141440 00000100:00100000:2.0:1788586944.122525:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788586944.122536:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:7649:x1875469208141440:12345-0@lo:101: 00010000:00010000:2.0:1788586944.122554:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586944.122575:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab8895a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.122605:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.122771:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.122783:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc21c6c00, rc 0) 00000100:00100000:2.0:1788586944.122901:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141440:12345-0@lo:101: Request processed in 366us (6442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.122907:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788586944.123210:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141440:0@lo:101: 00010000:00010000:3.0:1788586944.123434:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.123446:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586944.123596:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141568:0@lo:501: 00000100:00100000:3.0:1788586944.123637:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.132007:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20240 going to sleep for 11 seconds 00000100:00100000:2.0:1788586944.132315:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141568 00000100:00100000:2.0:1788586944.132327:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141568 00000100:00100000:2.0:1788586944.132404:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788586944.132416:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141568:12345-0@lo:501: 00000100:00100000:2.0:1788586944.132712:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141568:12345-0@lo:501: Request processed in 296us (9071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.132730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788586944.133113:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141568:0@lo:501: 00000100:00100000:3.0:1788586944.133372:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141696:0@lo:503: 00000100:00100000:3.0:1788586944.133439:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.133457:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20240 going to sleep for 11 seconds 00000100:00100000:2.0:1788586944.133530:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141696 00000100:00100000:2.0:1788586944.133535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141696 00000100:00100000:2.0:1788586944.133572:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788586944.133581:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141696:12345-0@lo:503: 00000100:00100000:2.0:1788586944.134078:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141696:12345-0@lo:503: Request processed in 360us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.134088:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788586944.134692:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141696:0@lo:503: 00000040:00080000:3.0:1788586944.135416:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788586944.135498:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141824:0@lo:502: 00000100:00100000:3.0:1788586944.135566:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.135607:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20240 going to sleep for 11 seconds 00000100:00100000:0.0:1788586944.140878:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141824 00000100:00100000:0.0:1788586944.140893:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141824 00000100:00100000:0.0:1788586944.141123:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788586944.141137:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141824:12345-0@lo:502: 00000100:00100000:0.0:1788586944.142333:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141824:12345-0@lo:502: Request processed in 1193us (6761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.142344:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788586944.143371:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141824:0@lo:502: 00000040:00080000:3.0:1788586944.143735:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788586944.143804:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788586944.144129:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141952:0@lo:502: 00000100:00100000:3.0:1788586944.144509:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.144606:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20240 going to sleep for 11 seconds 00000100:00100000:2.0:1788586944.144655:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208141952 00000100:00100000:2.0:1788586944.144662:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208141952 00000100:00100000:2.0:1788586944.145139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788586944.145162:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141952:12345-0@lo:502: 00000100:00100000:2.0:1788586944.145649:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208141952:12345-0@lo:502: Request processed in 499us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586944.145657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788586944.145778:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208141952:0@lo:502: 00000040:00080000:3.0:1788586944.146070:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788586944.146085:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788586944.147073:0:7659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586944.147146:0:7659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586944.147149:0:7659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788586944.147337:0:7659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacbb896000 00000020:00000080:1.0:1788586944.147340:0:7659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788586944.147371:0:7659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586944.147374:0:7659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586944.147376:0:7659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788586944.147379:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788586944.147550:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788586944.147573:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788586944.147718:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.147731:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586944.147775:0:7649:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788586944.147794:0:7649:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bacbb896000 10000000:01000000:3.0:1788586944.147797:0:7649:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bacbb896000 10000000:01000000:3.0:1788586944.147801:0:7649:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788586944.147807:0:7649:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bacbb896000 from 1 10000000:01000000:3.0:1788586944.147810:0:7649:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586944.147886:0:7649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.147895:0:7649:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.147908:0:7649:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586944.147936:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142080:0@lo:101: 00000100:00100000:3.0:1788586944.148010:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.148046:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586944.151958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142080 00000100:00100000:0.0:1788586944.151979:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142080 00000100:00100000:0.0:1788586944.152037:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788586944.152048:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208142080:12345-0@lo:101: 00010000:00010000:0.0:1788586944.152065:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586944.152083:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88968 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.152114:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.152142:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.152167:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80030600, rc 0) 00000100:00100000:0.0:1788586944.152267:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142080:12345-0@lo:101: Request processed in 221us (4257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.152274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788586944.153596:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142080:0@lo:101: 00010000:00010000:3.0:1788586944.153623:0:7649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.153635:0:7649:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586944.153760:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142208:0@lo:501: 00000100:00100000:3.0:1788586944.153810:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.153876:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586944.153968:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142208 00000100:00100000:1.0:1788586944.153976:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142208 00000100:00100000:1.0:1788586944.154012:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788586944.154021:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142208:12345-0@lo:501: 00000100:00100000:1.0:1788586944.154299:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142208:12345-0@lo:501: Request processed in 278us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.154307:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788586944.154434:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142208:0@lo:501: 00000100:00100000:2.0:1788586944.154471:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142336:0@lo:503: 00000100:00100000:2.0:1788586944.154514:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.154550:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788586944.155056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142336 00000100:00100000:1.0:1788586944.155062:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142336 00000100:00100000:1.0:1788586944.155106:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788586944.155114:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142336:12345-0@lo:503: 00000100:00100000:1.0:1788586944.155536:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142336:12345-0@lo:503: Request processed in 421us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.155544:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788586944.155632:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142336:0@lo:503: 00000040:00080000:2.0:1788586944.155962:0:7649:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788586944.156031:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142464:0@lo:502: 00000100:00100000:2.0:1788586944.156078:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.156106:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac87f74240 going to sleep for 11 seconds 00000100:00100000:3.0:1788586944.156577:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142464 00000100:00100000:3.0:1788586944.156585:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142464 00000100:00100000:3.0:1788586944.156630:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788586944.156645:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142464:12345-0@lo:502: 00000100:00100000:3.0:1788586944.156877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142464:12345-0@lo:502: Request processed in 233us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.156884:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788586944.156932:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142464:0@lo:502: 00000040:00080000:3.0:1788586944.158628:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788586944.158698:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788586944.158735:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788586944.158780:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788586944.158811:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788586944.158885:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788586944.158917:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788586944.159805:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788586944.160379:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788586944.160448:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788586944.160476:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788586944.160515:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788586944.160543:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788586944.160575:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788586944.160621:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788586944.160656:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788586944.160688:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788586944.160735:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788586944.160767:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788586944.160791:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788586944.162536:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788586944.162684:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788586944.162715:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788586944.162790:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788586944.162821:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788586944.164499:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788586944.164599:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788586944.164636:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788586944.164670:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788586944.164716:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788586944.164751:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788586944.164777:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788586944.164804:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788586944.166590:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788586944.166883:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788586944.167128:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788586944.167478:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788586944.167535:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142592:0@lo:502: 00000100:00100000:2.0:1788586944.167622:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.167663:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788586944.167776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142592 00000100:00100000:3.0:1788586944.167785:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142592 00000100:00100000:3.0:1788586944.167839:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788586944.167934:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142592:12345-0@lo:502: 00000100:00100000:3.0:1788586944.168636:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208142592:12345-0@lo:502: Request processed in 702us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.168645:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788586944.169138:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208142592:0@lo:502: 00000040:00080000:2.0:1788586944.169387:0:7649:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788586944.169415:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788586944.171721:0:7660:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788586944.171739:0:7660:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8bacbbc299c0) 00000020:00000080:1.0:1788586944.171762:0:7660:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788586944.171835:0:7660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacbb896000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788586944.171839:0:7660:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bacbb896000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788586944.171881:0:7660:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacbb896000 3 00010000:00080000:1.0:1788586944.171912:0:7660:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bacbbc31000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1788586944.179540:0:7660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788586944.179753:0:7660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788586944.179793:0:7660:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788586944.179807:0:7660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc1a730b05ab8897d 00000100:00080000:1.0:1788586944.179819:0:7660:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788586944.179827:0:7660:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bacbbc31000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1788586944.179889:0:7660:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbbcca680 x1875469208142720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788586944.181363:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208142720:0@lo:38: 00000100:00100000:3.0:1788586944.181455:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586944.181597:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142720 00000100:00100000:0.0:1788586944.181606:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142720 00000100:00100000:0.0:1788586944.181647:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788586944.181655:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875469208142720:12345-0@lo:38: 00010000:00080000:0.0:1788586944.181681:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1788586944.181715:0:5851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc1a730b05ab88984 00000004:00100000:0.0:1788586944.181730:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788586944.181764:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8bacbf51a000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788586944.181858:0:7660:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788586944.181953:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788586944.181964:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208142848:0@lo:400: 00000100:00100000:1.0:1788586944.182008:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.182038:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208142976:0@lo:400: 00000100:00100000:1.0:1788586944.182064:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.182084:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586944.182089:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208143104:0@lo:400: 00000100:00100000:1.0:1788586944.182112:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586944.182145:0:5852:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788586944.182152:0:5852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788586944.182167:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208143104 00000100:00100000:1.0:1788586944.182170:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208143104 00000100:00100000:1.0:1788586944.182209:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586944.184804:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208143104:12345-0@lo:400: 00000100:00100000:1.0:1788586944.185078:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208143104:12345-0@lo:400: Request processed in 2861us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.185091:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788586944.185263:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586944.187906:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbcc8000 x1875469208143104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586944.187928:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208143104:0@lo:400: 00000100:00100000:1.0:1788586944.187957:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788586944.187975:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142848 00000100:00100000:1.0:1788586944.187984:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142848 00000100:00100000:1.0:1788586944.188027:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788586944.188033:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208142976 00000100:00100000:1.0:1788586944.188037:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208142976 00000100:00100000:1.0:1788586944.188070:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788586944.188078:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788586944.188085:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586944.188086:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208142848:12345-0@lo:400: 00000100:00100000:0.0:1788586944.188176:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875469208142720:12345-0@lo:38: Request processed in 6519us (6719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.188185:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788586944.188220:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788586944.188228:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586944.188235:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208142976:12345-0@lo:400: 00000100:00100000:1.0:1788586944.195667:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208142848:12345-0@lo:400: Request processed in 4439us (10515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586944.195685:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788586944.195814:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbcc8a80 x1875469208142848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586944.195831:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208142848:0@lo:400: 00000100:00080000:1.0:1788586944.196371:0:7663:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8bacbbcc8a80 x1875469208143232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586944.196410:0:7663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3300 going to sleep for 0 seconds 00000040:00080000:1.0:1788586944.196528:0:7660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788586944.196621:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208142976:12345-0@lo:400: Request processed in 8383us (14552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.196631:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788586944.197340:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbcca300 x1875469208142976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586944.197353:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208142976:0@lo:400: 00000020:01000000:2.0:1788586944.197388:0:7649:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788586944.197432:0:7649:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788586944.197456:0:7649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586944.197468:0:7649:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788586944.197519:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788586944.197521:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788586944.197523:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586944.197525:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586944.197526:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586944.197532:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586944.197533:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788586944.197534:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586944.197536:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586944.197537:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586944.197538:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788586944.197543:0:7649:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788586944.197546:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788586944.197547:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788586944.197548:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586944.197549:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586944.197550:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586944.197551:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586944.197551:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788586944.197552:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586944.197553:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586944.197554:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586944.197555:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788586944.197576:0:7649:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788586944.197589:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208143360:0@lo:253: 00000100:00100000:2.0:1788586944.197643:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586944.197672:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82baeb40 going to sleep for 11 seconds 00010000:00080000:3.0:1788586944.202478:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbbcca680 x1875469208142720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788586954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586944.202496:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788586944.202508:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788586944.202518:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788586944.202526:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788586944.202529:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc31000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788586944.202538:0:3311:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000069bbe166): req@ffff8bacbbcc8a80 x1875469208143232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586944.202574:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208142720:0@lo:38: 00010000:00010000:3.0:1788586944.202712:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586944.202901:0:7663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586944.202927:0:7663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788586944.202965:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208143360 00000100:00100000:1.0:1788586944.202973:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208143360 00000100:00100000:3.0:1788586944.202982:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208143232 00000100:00100000:3.0:1788586944.202985:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208143232 00000100:00100000:1.0:1788586944.203015:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788586944.203026:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7649:x1875469208143360:12345-0@lo:253: 20000000:01000000:1.0:1788586944.203054:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788586944.203059:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788586944.203065:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7663:x1875469208143232:12345-0@lo:901: 20000000:01000000:1.0:1788586944.203070:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788586944.204683:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7663:x1875469208143232:12345-0@lo:901: Request processed in 1610us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.204694:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788586944.207462:0:7663:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcc8a80 x1875469208143232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788586960 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586944.207483:0:7663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7663:1875469208143232:0@lo:901: 00000100:00080000:0.0:1788586944.213273:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1788586944.304989:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788586944.305011:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788586944.305345:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788586944.305350:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788586944.305373:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.305404:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.305413:0:5866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.305456:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586944.305473:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 14 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586944.305488:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875469208143488:0@lo:104: 00000100:00100000:3.0:1788586944.305557:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586944.305622:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788586944.306608:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208143488 00000100:00100000:0.0:1788586944.306619:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208143488 00000100:00100000:0.0:1788586944.306686:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788586944.306696:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5866:x1875469208143488:12345-0@lo:104: 00010000:00010000:0.0:1788586944.306712:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.306789:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586944.306794:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:5866:x1875469208143488:12345-0@lo:104: Request processed in 101us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.306801:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788586944.306877:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875469208143488:0@lo:104: 00010000:00010000:0.0:1788586944.306900:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.306918:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788586944.306926:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.306933:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5a00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788586944.307404:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307416:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586944.307422:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586944.307447:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788586944.307493:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307500:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586944.307517:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307524:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab888d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab888dc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307541:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586944.307543:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586944.307545:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586944.307554:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788586944.307568:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208143616:0@lo:103: 00000100:00100000:0.0:1788586944.307610:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586944.307653:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208143616 00000100:00100000:0.0:1788586944.307658:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208143616 00010000:00010000:0.0:1788586944.307678:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586944.307702:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788586944.307710:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88342450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:3315:x1875469208143616:12345-0@lo:103: 00010000:00010000:0.0:1788586944.307720:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586944.307726:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307736:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307755:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030e00/0xc1a730b05ab888dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab888d5 expref: 15 pid: 5845 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307769:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307777:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788586944.307789:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008264451s 00010000:00010000:0.0:1788586944.307793:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307800:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307807:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307813:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307819:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788586944.307823:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307831:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307878:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.307898:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586944.307930:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88342450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3315:x1875469208143616:12345-0@lo:103: Request processed in 221us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586944.311521:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788586944.311628:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.311641:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586944.311649:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab8898b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586944.311706:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208143616:0@lo:103: 00000100:00100000:3.0:1788586944.330411:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:7649:x1875469208143360:12345-0@lo:253: Request processed in 127377us (132758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586944.330426:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788586944.330570:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7649:1875469208143360:0@lo:253: 10000000:01000000:2.0:1788586944.330586:0:7649:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788586944.330590:0:7649:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788586944.330591:0:7649:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788586944.330593:0:7649:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788586944.330594:0:7649:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788586944.330595:0:7649:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788586944.330596:0:7649:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788586944.330597:0:7649:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788586944.330598:0:7649:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788586944.330606:0:7649:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788586944.330608:0:7649:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788586944.330610:0:7649:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788586944.330625:0:7649:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788586944.341111:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586944.343407:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586944.343670:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586944.344646:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788586944.345693:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788586944.346110:0:7649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788586944.347664:0:7649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788586944.724929:0:7649:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788586944.724937:0:7649:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788586944.724980:0:7649:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788586944.725041:0:7649:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788586944.725057:0:7649:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788586944.725092:0:7649:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788586945.222466:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586945.539331:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208143744:0@lo:13: 00000100:00100000:0.0:1788586945.539422:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586945.540140:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208143744 00000100:00100000:3.0:1788586945.540150:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208143744 00000100:00100000:3.0:1788586945.540216:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788586945.540227:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208143744:12345-0@lo:13: 00002000:00000024:3.0:1788586945.540262:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788586945.540377:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208143744:12345-0@lo:13: Request processed in 141us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586945.540385:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788586945.551282:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbccb800 x1875469208143744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586945.551316:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208143744:0@lo:13: 00010000:00010000:0.0:1788586946.249695:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586947.273414:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586948.296884:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586949.317939:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586949.639170:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208143872:0@lo:400: 00000100:00100000:1.0:1788586949.639281:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.643210:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586949.643244:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208144000:0@lo:400: 00000100:00100000:1.0:1788586949.643363:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.643433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208143872 00000100:00100000:1.0:1788586949.643443:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208143872 00000100:00100000:1.0:1788586949.646271:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788586949.646305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3312:x1875469208143872:12345-0@lo:400: 00000100:00100000:1.0:1788586949.646657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3312:x1875469208143872:12345-0@lo:400: Request processed in 371us (7375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586949.646665:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788586949.646728:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144000 00000100:00100000:1.0:1788586949.646738:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144000 00000100:00100000:1.0:1788586949.646776:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788586949.646782:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208144000:12345-0@lo:400: 00000100:00100000:1.0:1788586949.646816:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208144000:12345-0@lo:400: Request processed in 34us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586949.646823:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788586949.646901:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5947b80 x1875469208144000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586949.646922:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208144000:0@lo:400: 00000100:00100000:1.0:1788586949.646937:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208143872:0@lo:400: 00000100:00100000:2.0:1788586949.652463:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586949.652540:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208144256:0@lo:400: 00000100:00100000:1.0:1788586949.652640:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.652699:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788586949.652706:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208144128:0@lo:400: 00000100:00100000:1.0:1788586949.652735:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586949.652774:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144256 00000100:00100000:1.0:1788586949.652784:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144256 00000100:00100000:1.0:1788586949.652893:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788586949.652904:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208144256:12345-0@lo:400: 00000100:00100000:1.0:1788586949.652966:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208144256:12345-0@lo:400: Request processed in 64us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586949.652986:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788586949.653012:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788586949.653302:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208144384:0@lo:400: 00000100:00100000:2.0:1788586949.653722:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586949.653791:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144128 00000100:00100000:2.0:1788586949.653796:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144128 00000100:00100000:2.0:1788586949.653839:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144384 00000100:00100000:2.0:1788586949.653859:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144384 00000100:00100000:2.0:1788586949.653886:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788586949.653895:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208144128:12345-0@lo:400: 00000100:00100000:2.0:1788586949.653940:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208144128:12345-0@lo:400: Request processed in 46us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586949.653948:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788586949.653962:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788586949.653968:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208144384:12345-0@lo:400: 00000100:00100000:2.0:1788586949.653996:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208144384:12345-0@lo:400: Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586949.654004:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788586949.656160:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5947b80 x1875469208144256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586949.656185:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208144256:0@lo:400: 00010000:00080000:2.0:1788586949.656874:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5947800 x1875469208144384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586949.656889:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208144384:0@lo:400: 00000100:00080000:2.0:1788586949.656953:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788586949.657338:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5946d80 x1875469208144128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586949.657349:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208144128:0@lo:400: 00010000:00010000:2.0:1788586950.340612:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788586950.661802:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788586950.661814:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bacaf3ef800 from 30 10000000:01000000:1.0:1788586950.661822:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586950.661903:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.661918:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.661931:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586950.661963:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208144512:0@lo:101: 00000100:00100000:1.0:1788586950.662065:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.662137:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883a4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586950.662149:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144512 00000100:00100000:3.0:1788586950.662161:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144512 00000100:00100000:3.0:1788586950.662229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788586950.662241:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208144512:12345-0@lo:101: 00010000:00010000:3.0:1788586950.662258:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586950.662285:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88992 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.662318:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.662327:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.662338:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4000, rc 0) 00000100:00100000:3.0:1788586950.662385:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208144512:12345-0@lo:101: Request processed in 147us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586950.662392:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788586950.662518:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208144512:0@lo:101: 00010000:00010000:1.0:1788586950.662536:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.662559:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586950.662618:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208144640:0@lo:501: 00000100:00100000:1.0:1788586950.662644:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.662660:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883a4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.662673:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144640 00000100:00100000:1.0:1788586950.662677:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144640 00000100:00100000:1.0:1788586950.662703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788586950.662710:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208144640:12345-0@lo:501: 00000100:00100000:3.0:1788586950.663212:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208144768:0@lo:13: 00000100:00100000:3.0:1788586950.663254:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.663362:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144768 00000100:00100000:3.0:1788586950.663367:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144768 00000100:00100000:3.0:1788586950.663408:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788586950.663416:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208144768:12345-0@lo:13: 00002000:00000024:3.0:1788586950.663452:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788586950.663497:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208144768:12345-0@lo:13: Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586950.663503:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788586950.663540:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83050e00 x1875469208144768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586950.663560:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208144768:0@lo:13: 00000100:00100000:1.0:1788586950.666285:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208144640:12345-0@lo:501: Request processed in 3554us (3618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.666303:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788586950.666340:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208144640:0@lo:501: 00000100:00100000:0.0:1788586950.666412:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208144896:0@lo:503: 00000100:00100000:0.0:1788586950.666470:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.666515:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.666694:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208144896 00000100:00100000:1.0:1788586950.666703:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208144896 00000100:00100000:1.0:1788586950.666753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788586950.666762:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208144896:12345-0@lo:503: 00000100:00100000:1.0:1788586950.668018:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208144896:12345-0@lo:503: Request processed in 1251us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.668913:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788586950.669332:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208144896:0@lo:503: 00000100:00100000:3.0:1788586950.669771:0:7889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7889:1875469208145024:0@lo:502: 00000100:00100000:3.0:1788586950.670065:0:7889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.670149:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145024 00000100:00100000:0.0:1788586950.670157:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145024 00000100:00100000:0.0:1788586950.670207:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788586950.670217:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7889:x1875469208145024:12345-0@lo:502: 00000100:00100000:0.0:1788586950.670610:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7889:x1875469208145024:12345-0@lo:502: Request processed in 394us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.670619:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788586950.674375:0:7889:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac84cd83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586950.674435:0:7889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7889:1875469208145024:0@lo:502: 00000100:00100000:2.0:1788586950.674543:0:7889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7889:1875469208145152:0@lo:502: 00000100:00100000:2.0:1788586950.674647:0:7889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.674725:0:7889:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac908cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.679597:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145152 00000100:00100000:1.0:1788586950.679629:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145152 00000100:00100000:1.0:1788586950.679710:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788586950.679722:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7889:x1875469208145152:12345-0@lo:502: 00000100:00100000:1.0:1788586950.680280:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:7889:x1875469208145152:12345-0@lo:502: Request processed in 545us (5619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.680300:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788586950.680399:0:7889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7889:1875469208145152:0@lo:502: 00000040:00080000:2.0:1788586950.680449:0:7889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788586950.680650:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788586950.680675:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586950.680689:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.680702:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586950.680713:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788586950.680717:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788586950.680720:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788586950.680763:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.680771:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.680780:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586950.680803:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145280:0@lo:101: 00000100:00100000:1.0:1788586950.681557:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.681673:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.681705:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145280 00000100:00100000:0.0:1788586950.681713:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145280 00000100:00100000:0.0:1788586950.681782:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788586950.681793:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208145280:12345-0@lo:101: 00010000:00010000:0.0:1788586950.681810:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586950.681838:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab889a0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.681981:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.682003:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.682013:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80031600, rc 0) 00000100:00100000:0.0:1788586950.682055:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208145280:12345-0@lo:101: Request processed in 264us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.682061:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788586950.682322:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145280:0@lo:101: 00010000:00010000:1.0:1788586950.682339:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.682348:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586950.682419:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145408:0@lo:501: 00000100:00100000:1.0:1788586950.682451:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.682509:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb44fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.682536:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145408 00000100:00100000:0.0:1788586950.682540:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145408 00000100:00100000:0.0:1788586950.682566:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788586950.682572:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208145408:12345-0@lo:501: 00000100:00100000:0.0:1788586950.682917:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208145408:12345-0@lo:501: Request processed in 344us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.682924:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788586950.683006:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145408:0@lo:501: 00000100:00100000:1.0:1788586950.683036:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145536:0@lo:503: 00000100:00100000:1.0:1788586950.683081:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.683103:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb44fdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.683218:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145536 00000100:00100000:0.0:1788586950.683223:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145536 00000100:00100000:0.0:1788586950.683252:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788586950.683259:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208145536:12345-0@lo:503: 00000100:00100000:0.0:1788586950.683591:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208145536:12345-0@lo:503: Request processed in 333us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.683598:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788586950.686321:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145536:0@lo:503: 00000100:00100000:1.0:1788586950.686616:0:7890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7890:1875469208145664:0@lo:502: 00000100:00100000:1.0:1788586950.686715:0:7890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.686758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145664 00000100:00100000:1.0:1788586950.686764:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145664 00000100:00100000:1.0:1788586950.686808:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788586950.686816:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7890:x1875469208145664:12345-0@lo:502: 00000100:00100000:0.0:1788586950.689375:0:7890:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82ba5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.689386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7890:x1875469208145664:12345-0@lo:502: Request processed in 2564us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.689406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788586950.689415:0:7890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7890:1875469208145664:0@lo:502: 00000020:01000000:0.0:1788586950.689469:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586950.689482:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586950.689485:0:7890:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788586950.689491:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788586950.689493:0:7890:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788586950.689534:0:7890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7890:1875469208145792:0@lo:502: 00000100:00100000:0.0:1788586950.689594:0:7890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.689629:0:7890:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586950.689674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145792 00000100:00100000:2.0:1788586950.689682:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145792 00000100:00100000:1.0:1788586950.692874:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788586950.692902:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7890:x1875469208145792:12345-0@lo:502: 00000100:00100000:1.0:1788586950.693296:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:7890:x1875469208145792:12345-0@lo:502: Request processed in 403us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.693306:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788586950.702070:0:7890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7890:1875469208145792:0@lo:502: 00000020:01000000:0.0:1788586950.702141:0:7890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586950.702151:0:7890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586950.702154:0:7890:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788586950.702161:0:7890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788586950.702297:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788586950.702327:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788586950.702342:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.702356:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586950.702369:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788586950.702373:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bac83941800 from 30 10000000:01000000:3.0:1788586950.702377:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586950.702432:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.702454:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.702465:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586950.702493:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145920:0@lo:101: 00000100:00100000:3.0:1788586950.702593:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.702651:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac84cd83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.702772:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208145920 00000100:00100000:0.0:1788586950.702782:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208145920 00000100:00100000:0.0:1788586950.702991:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788586950.703002:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208145920:12345-0@lo:101: 00010000:00010000:0.0:1788586950.703021:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586950.703101:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab889ae expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.703133:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.703147:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.703158:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80031800, rc 0) 00000100:00100000:0.0:1788586950.703215:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208145920:12345-0@lo:101: Request processed in 214us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.703228:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788586950.703286:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208145920:0@lo:101: 00010000:00010000:0.0:1788586950.703302:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.703313:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586950.703374:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146048:0@lo:501: 00000100:00100000:0.0:1788586950.703401:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.703416:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.703431:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146048 00000100:00100000:0.0:1788586950.703435:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146048 00000100:00100000:0.0:1788586950.703462:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788586950.703468:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208146048:12345-0@lo:501: 00000100:00100000:0.0:1788586950.703788:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208146048:12345-0@lo:501: Request processed in 318us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.703796:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788586950.706002:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146048:0@lo:501: 00000100:00100000:0.0:1788586950.706159:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146176:0@lo:503: 00000100:00100000:0.0:1788586950.706279:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.706320:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.706365:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146176 00000100:00100000:0.0:1788586950.706373:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146176 00000100:00100000:0.0:1788586950.706426:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788586950.706436:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208146176:12345-0@lo:503: 00000100:00100000:0.0:1788586950.706697:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208146176:12345-0@lo:503: Request processed in 261us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.706706:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788586950.706751:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146176:0@lo:503: 00000100:00100000:0.0:1788586950.709692:0:7896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7896:1875469208146304:0@lo:502: 00000100:00100000:0.0:1788586950.709810:0:7896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.709892:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146304 00000100:00100000:0.0:1788586950.709902:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146304 00000100:00100000:0.0:1788586950.709954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788586950.709964:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:7896:x1875469208146304:12345-0@lo:502: 00000100:00100000:0.0:1788586950.712758:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:7896:x1875469208146304:12345-0@lo:502: Request processed in 2781us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.712778:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788586950.713285:0:7896:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82ba5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.713323:0:7896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7896:1875469208146304:0@lo:502: 00000100:00100000:0.0:1788586950.713414:0:7896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7896:1875469208146432:0@lo:502: 00000100:00100000:0.0:1788586950.713464:0:7896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.713500:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146432 00000100:00100000:0.0:1788586950.713506:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146432 00000100:00100000:0.0:1788586950.713545:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788586950.713554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:7896:x1875469208146432:12345-0@lo:502: 00000100:00100000:0.0:1788586950.713764:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:7896:x1875469208146432:12345-0@lo:502: Request processed in 209us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.713771:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788586950.713796:0:7896:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82ba5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.715136:0:7896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7896:1875469208146432:0@lo:502: 00000040:00080000:0.0:1788586950.715190:0:7896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788586950.715311:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788586950.715335:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586950.715349:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.715363:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586950.715374:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788586950.715376:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac83941800 from 5 10000000:01000000:0.0:1788586950.715380:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788586950.715422:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.715431:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.715442:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586950.715463:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146560:0@lo:101: 00000100:00100000:0.0:1788586950.715524:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.715548:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82ba5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788586950.715574:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146560 00000100:00100000:0.0:1788586950.715582:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146560 00000100:00100000:0.0:1788586950.715625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788586950.715634:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208146560:12345-0@lo:101: 00010000:00010000:0.0:1788586950.715648:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586950.715669:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80030000/0xc1a730b05ab889c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab889bc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.715696:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030000/0xc1a730b05ab889c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab889bc expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.715708:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80030000/0xc1a730b05ab889c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889bc expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.715717:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80030000, rc 0) 00000100:00100000:0.0:1788586950.715766:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208146560:12345-0@lo:101: Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.715774:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788586950.718660:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146560:0@lo:101: 00010000:00010000:1.0:1788586950.718700:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.718715:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586950.718810:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146688:0@lo:256: 00000100:00100000:1.0:1788586950.718919:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.718973:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac87f5ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.721956:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146688 00000100:00100000:1.0:1788586950.721980:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146688 00000100:00100000:1.0:1788586950.722065:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788586950.722078:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208146688:12345-0@lo:256: 20000000:01000000:1.0:1788586950.722119:0:5845:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788586950.722144:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788586950.722148:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788586950.722324:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208146688:12345-0@lo:256: Request processed in 248us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.722334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788586950.722409:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146688:0@lo:256: 10000000:01000000:1.0:1788586950.722474:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788586950.722486:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.722499:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586950.722510:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788586950.722513:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788586950.722516:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788586950.722554:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.722563:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.722573:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586950.722598:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146816:0@lo:101: 00000100:00100000:1.0:1788586950.722634:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.722670:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82ba5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.724544:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146816 00000100:00100000:1.0:1788586950.724565:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146816 00000100:00100000:1.0:1788586950.724630:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586950.724642:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208146816:12345-0@lo:101: 00010000:00010000:1.0:1788586950.724662:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586950.724684:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab889ca expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.724726:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.724740:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.724751:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051600, rc 0) 00000100:00100000:1.0:1788586950.724830:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208146816:12345-0@lo:101: Request processed in 191us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.724837:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788586950.728151:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146816:0@lo:101: 00010000:00010000:1.0:1788586950.728203:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586950.728218:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586950.728354:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146944:0@lo:501: 00000100:00100000:1.0:1788586950.728432:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.728492:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82ba5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.728527:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208146944 00000100:00100000:1.0:1788586950.728532:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208146944 00000100:00100000:1.0:1788586950.728576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788586950.728585:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208146944:12345-0@lo:501: 00000100:00100000:1.0:1788586950.728969:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208146944:12345-0@lo:501: Request processed in 384us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.728976:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788586950.729039:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208146944:0@lo:501: 00000100:00100000:1.0:1788586950.729071:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208147072:0@lo:503: 00000100:00100000:1.0:1788586950.729116:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.729130:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831f0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.729142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147072 00000100:00100000:1.0:1788586950.729146:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147072 00000100:00100000:1.0:1788586950.729167:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586950.729173:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208147072:12345-0@lo:503: 00000100:00100000:1.0:1788586950.729519:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208147072:12345-0@lo:503: Request processed in 344us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.729525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788586950.729561:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208147072:0@lo:503: 00000100:00100000:2.0:1788586950.748295:0:7897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7897:1875469208147200:0@lo:502: 00000100:00100000:2.0:1788586950.748408:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.748452:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac908ccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.750817:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147200 00000100:00100000:1.0:1788586950.750838:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147200 00000100:00100000:1.0:1788586950.750936:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788586950.750950:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:7897:x1875469208147200:12345-0@lo:502: 00000100:00100000:1.0:1788586950.751468:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:7897:x1875469208147200:12345-0@lo:502: Request processed in 519us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.751476:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788586950.751498:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7897:1875469208147200:0@lo:502: 00000020:01000000:2.0:1788586950.751545:0:7897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788586950.751555:0:7897:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788586950.751563:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586950.751566:0:7897:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788586950.751572:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788586950.751577:0:7897:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:2.0:1788586950.751608:0:7897:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788586950.751611:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788586950.751646:0:7897:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8bab81218000) 00000020:00000080:2.0:1788586950.751682:0:7897:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788586950.751690:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788586950.751795:0:7897:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788586950.751802:0:7897:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788586950.754480:0:7897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab889df 00010000:00080000:2.0:1788586950.754577:0:7897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bab81224800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:1.0:1788586950.760123:0:7897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788586950.760569:0:7897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788586950.760590:0:7897:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788586950.761255:0:7897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586950.761505:0:7897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788586950.761558:0:7897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788586950.761620:0:7897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788586950.767211:0:7898:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788586950.767221:0:7898:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788586950.771506:0:7897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788586950.771528:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788586950.771587:0:7897:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788586950.771617:0:7897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab889e6 00000100:00080000:2.0:1788586950.771631:0:7897:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788586950.771640:0:7897:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bab81224800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1788586950.771689:0:7897:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacb5947800 x1875469208147328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788586950.771716:0:7897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788586950.771784:0:7897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586950.771788:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586950.771791:0:7897:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788586950.771794:0:7897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586950.771798:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586950.771800:0:7897:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788586950.771803:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788586950.771805:0:7897:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788586950.771894:0:7897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7897:1875469208147456:0@lo:502: 00000100:00100000:2.0:1788586950.772008:0:7897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.772191:0:7897:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac908cc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586950.772214:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208147328:0@lo:8: 00000100:00100000:2.0:1788586950.772250:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.772354:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208147584:0@lo:400: 00000100:00100000:2.0:1788586950.772403:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.772424:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586950.772430:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208147712:0@lo:400: 00000100:00100000:2.0:1788586950.772450:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.772474:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208147840:0@lo:400: 00000100:00100000:2.0:1788586950.772494:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.772529:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147584 00000100:00100000:2.0:1788586950.772536:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147584 00000100:00100000:2.0:1788586950.772578:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147712 00000100:00100000:2.0:1788586950.772581:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147712 00000100:00100000:2.0:1788586950.772594:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147840 00000100:00100000:2.0:1788586950.772596:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147840 00000100:00100000:2.0:1788586950.772611:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788586950.772620:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208147584:12345-0@lo:400: 00000100:00100000:2.0:1788586950.772674:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208147584:12345-0@lo:400: Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586950.772681:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788586950.772696:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788586950.772702:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208147712:12345-0@lo:400: 00000100:00100000:2.0:1788586950.772725:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208147712:12345-0@lo:400: Request processed in 23us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586950.772732:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788586950.772742:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788586950.772748:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208147840:12345-0@lo:400: 00000100:00100000:2.0:1788586950.772777:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208147840:12345-0@lo:400: Request processed in 29us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586950.772783:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788586950.772837:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5947b80 x1875469208147840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586950.774890:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147456 00000100:00100000:1.0:1788586950.774934:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147456 00000100:00100000:1.0:1788586950.775019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788586950.775031:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:7897:x1875469208147456:12345-0@lo:502: 00000100:00100000:2.0:1788586950.775324:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208147840:0@lo:400: 00010000:00080000:2.0:1788586950.775397:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5946d80 x1875469208147712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586950.775408:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208147712:0@lo:400: 00010000:00080000:2.0:1788586950.775420:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5946a00 x1875469208147584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586950.775429:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208147584:0@lo:400: 00000100:00100000:1.0:1788586950.775436:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:7897:x1875469208147456:12345-0@lo:502: Request processed in 408us (3429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.775443:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788586950.775502:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147328 00000100:00100000:1.0:1788586950.775507:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147328 00000100:00100000:1.0:1788586950.775537:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586950.775543:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875469208147328:12345-0@lo:8: 00010000:00080000:1.0:1788586950.775574:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1788586950.775614:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab889ed 00002000:00100000:1.0:1788586950.775634:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8bacbbc34000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788586950.775639:0:6707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788586950.775644:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788586950.775782:0:6707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788586950.776018:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788586950.776051:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc36000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788586950.776106:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875469208147328:12345-0@lo:8: Request processed in 562us (3855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.776114:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788586950.776159:0:7897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:7897:1875469208147456:0@lo:502: 00000020:01000000:1.0:1788586950.776197:0:7897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586950.776206:0:7897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586950.776209:0:7897:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788586950.776214:0:7897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:2.0:1788586950.776386:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5947800 x1875469208147328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788586960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586950.776397:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788586950.776406:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788586950.776415:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788586950.776420:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788586950.776423:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81224800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788586950.776476:0:7898:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788586950.776600:0:7898:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 272980755887ns, next at 0ns, rc = 0 00000020:01000000:3.0:1788586950.777141:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788586950.777166:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788586950.777182:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.777194:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586950.777207:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788586950.777210:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bac912719c0 from 1 10000000:01000000:3.0:1788586950.777213:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788586950.777258:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.777277:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586950.777288:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586950.777324:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208147968:0@lo:101: 00000004:00080000:2.0:1788586950.777325:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788586950.777333:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208147328:0@lo:8: 00000100:00100000:3.0:1788586950.777381:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586950.777432:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac84cd83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586950.779241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208147968 00000100:00100000:2.0:1788586950.779260:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208147968 00000100:00100000:2.0:1788586950.779336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788586950.779348:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208147968:12345-0@lo:101: 00010000:00010000:2.0:1788586950.779369:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586950.779391:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab889f4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.779441:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.779455:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.779466:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc21c7000, rc 0) 00000100:00100000:2.0:1788586950.779549:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208147968:12345-0@lo:101: Request processed in 203us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586950.779556:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788586950.790548:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208147968:0@lo:101: 00010000:00010000:2.0:1788586950.790587:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586950.790603:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586950.790706:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208148096:0@lo:501: 00000100:00100000:2.0:1788586950.790788:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586950.791244:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac84cd83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586950.793428:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148096 00000100:00100000:3.0:1788586950.793449:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148096 00000100:00100000:3.0:1788586950.793523:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788586950.793535:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208148096:12345-0@lo:501: 00000100:00100000:3.0:1788586950.797501:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208148096:12345-0@lo:501: Request processed in 3951us (6698us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788586950.797520:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788586950.798257:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208148096:0@lo:501: 10000000:01000000:0.0:1788586950.798324:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788586950.798338:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586950.798351:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788586950.884383:0:7899:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788586950.884431:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148352:0@lo:7: 00000100:00100000:0.0:1788586950.884533:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.884600:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac893f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.884758:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148352 00000100:00100000:1.0:1788586950.884787:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148352 00000100:00100000:1.0:1788586950.884904:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788586950.884915:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7899:x1875469208148352:12345-0@lo:7: 00000100:00080000:0.0:1788586950.888222:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788586950.888970:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788586950.889134:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208148224:0@lo:13: 00000100:00100000:2.0:1788586950.889236:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.889365:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148224 00000100:00100000:0.0:1788586950.889383:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148224 00000100:00100000:0.0:1788586950.889450:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788586950.889460:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875469208148224:12345-0@lo:13: 00002000:00000024:0.0:1788586950.889501:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788586950.889560:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875469208148224:12345-0@lo:13: Request processed in 101us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586950.889567:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788586950.889611:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83050a80 x1875469208148224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586950.889636:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208148224:0@lo:13: 00002000:00080000:1.0:1788586950.895295:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788586950.895307:0:6706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788586950.897013:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7899:x1875469208148352:12345-0@lo:7: Request processed in 12085us (12463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586950.897164:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788586950.898711:0:7899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83052680 x1875469208148352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788586966 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586950.898734:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148352:0@lo:7: 00000004:00080000:0.0:1788586950.898754:0:7899:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788586950.899962:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148480:0@lo:5: 00000100:00100000:0.0:1788586950.900119:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586950.900239:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac893f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.903599:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148480 00000100:00100000:1.0:1788586950.903619:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148480 00000100:00100000:1.0:1788586950.903698:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788586950.903711:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7899:x1875469208148480:12345-0@lo:5: 00002000:00080000:1.0:1788586950.903759:0:6707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788586950.903764:0:6707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788586950.904397:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7899:x1875469208148480:12345-0@lo:5: Request processed in 687us (4277us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788586950.904407:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788586950.904486:0:7899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83052680 x1875469208148480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586966 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586950.904506:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148480:0@lo:5: 00000004:00080000:1.0:1788586950.904524:0:7899:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788586950.904577:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148608:0@lo:700: 00000100:00100000:1.0:1788586950.904617:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.904658:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb4d85540 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.904679:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148608 00000100:00100000:1.0:1788586950.904684:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148608 00000100:00100000:1.0:1788586950.904718:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586950.904726:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7899:x1875469208148608:12345-0@lo:700: 00000100:00100000:1.0:1788586950.904777:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1875469208148736:0@lo:700: 00000100:00100000:1.0:1788586950.904829:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586950.904881:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb4d85cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586950.904900:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148736 00000100:00100000:1.0:1788586950.904904:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148736 00000100:00100000:1.0:1788586950.904933:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788586950.904940:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1875469208148736:12345-0@lo:700: 40000000:02000000:1.0:1788586950.980939:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788586950.998611:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1875469208148736:12345-0@lo:700: Request processed in 93656us (93766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586950.998640:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788586950.998718:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcc9500 x1875469208148736/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788586966 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586950.998737:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1875469208148736:0@lo:700: 40000000:02000000:3.0:1788586950.998755:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1788586951.140991:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788586951.141032:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788586951.141363:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7899:x1875469208148608:12345-0@lo:700: Request processed in 236630us (236737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586951.141379:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788586951.141500:0:7899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcca300 x1875469208148608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788586966 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586951.141514:0:7899:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788586951.141537:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148608:0@lo:700: 00000004:02000040:1.0:1788586951.193303:0:7899:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788586951.204341:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148864:0@lo:5: 00000100:00100000:0.0:1788586951.204451:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586951.204523:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148864 00000100:00100000:0.0:1788586951.204535:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148864 00000100:00100000:0.0:1788586951.204619:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586951.204632:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7899:x1875469208148864:12345-0@lo:5: 00000100:00100000:1.0:1788586951.209203:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac893f0b40 going to sleep for 11 seconds 00002000:00080000:0.0:1788586951.232818:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788586951.233126:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788586951.248325:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7899:x1875469208148864:12345-0@lo:5: Request processed in 43682us (43860us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788586951.248342:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788586951.249147:0:7899:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83053800 x1875469208148864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788586967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586951.249173:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7899:1875469208148864:0@lo:5: 00000004:00080000:2.0:1788586951.249210:0:7899:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788586951.371995:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586952.389292:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586953.412644:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788586953.779456:0:8013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788586954.438372:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586955.461097:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586955.779594:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208149248:0@lo:400: 00000100:00100000:0.0:1788586955.779688:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586955.779770:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586955.779777:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208149376:0@lo:400: 00000100:00100000:0.0:1788586955.779816:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586955.780099:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208149376 00000100:00100000:0.0:1788586955.780110:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208149376 00000100:00100000:0.0:1788586955.780188:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788586955.780199:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208149376:12345-0@lo:400: 00000100:00100000:0.0:1788586955.780266:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208149376:12345-0@lo:400: Request processed in 69us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586955.780274:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788586955.780298:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788586955.780335:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcc8a80 x1875469208149376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586955.780354:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208149376:0@lo:400: 00000100:00100000:1.0:1788586955.780440:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208149248 00000100:00100000:1.0:1788586955.780445:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208149248 00000100:00100000:1.0:1788586955.780484:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788586955.780491:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208149248:12345-0@lo:400: 00000100:00100000:1.0:1788586955.780528:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208149248:12345-0@lo:400: Request processed in 38us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586955.780534:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788586955.780638:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788586955.780657:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcca680 x1875469208149248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586955.780666:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208149248:0@lo:400: 00000100:00100000:2.0:1788586955.781368:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208148992:0@lo:400: 00000100:00100000:2.0:1788586955.781428:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586955.781476:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208149504:0@lo:400: 00000100:00100000:2.0:1788586955.781504:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586955.781537:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788586955.781543:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208149120:0@lo:400: 00000100:00100000:2.0:1788586955.781564:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586955.781581:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208149632:0@lo:400: 00000100:00100000:2.0:1788586955.781601:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586955.781634:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208149504 00000100:00100000:2.0:1788586955.781639:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208149504 00000100:00100000:2.0:1788586955.781691:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208149120 00000100:00100000:2.0:1788586955.781694:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208149120 00000100:00100000:2.0:1788586955.781712:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586955.781719:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208149504:12345-0@lo:400: 00000100:00100000:2.0:1788586955.781764:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208149504:12345-0@lo:400: Request processed in 46us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586955.781772:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586955.781786:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788586955.781805:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208149120:12345-0@lo:400: 00000100:00100000:2.0:1788586955.781834:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208149120:12345-0@lo:400: Request processed in 43us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586955.781960:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788586955.782167:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcc9500 x1875469208149120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586955.782190:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208149120:0@lo:400: 00010000:00080000:2.0:1788586955.782204:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadc000 x1875469208149504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586955.782213:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208149504:0@lo:400: 00000100:00100000:1.0:1788586955.782387:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208148992 00000100:00100000:1.0:1788586955.782392:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208148992 00000100:00100000:1.0:1788586955.782431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788586955.782447:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208148992:12345-0@lo:400: 00000100:00100000:1.0:1788586955.782490:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208148992:12345-0@lo:400: Request processed in 44us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586955.782497:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788586955.783128:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208149632 00000100:00100000:0.0:1788586955.783135:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208149632 00000100:00100000:0.0:1788586955.783192:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788586955.783211:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208149632:12345-0@lo:400: 00000100:00100000:0.0:1788586955.783265:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208149632:12345-0@lo:400: Request processed in 56us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586955.783272:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788586955.783295:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586955.783300:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788586955.783483:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfade300 x1875469208149632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586955.783498:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208149632:0@lo:400: 00000100:00100000:2.0:1788586955.783509:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208148992:0@lo:400: 00000100:00100000:1.0:1788586955.788339:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208149760:0@lo:13: 00000100:00100000:1.0:1788586955.788437:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586955.788570:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208149760 00000100:00100000:2.0:1788586955.788581:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208149760 00000100:00100000:2.0:1788586955.788648:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788586955.788668:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208149760:12345-0@lo:13: 00002000:00000024:2.0:1788586955.788717:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586955.788771:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208149760:12345-0@lo:13: Request processed in 115us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586955.788779:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788586955.788838:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadca80 x1875469208149760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586955.788886:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208149760:0@lo:13: 00000100:00100000:0.0:1788586956.292153:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208149888:0@lo:13: 00000100:00100000:0.0:1788586956.292274:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586956.293176:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208149888 00000100:00100000:2.0:1788586956.293202:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208149888 00000100:00100000:2.0:1788586956.293264:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788586956.293275:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875469208149888:12345-0@lo:13: 00002000:00000024:2.0:1788586956.293317:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586956.293389:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875469208149888:12345-0@lo:13: Request processed in 115us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586956.293396:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788586956.293592:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d83800 x1875469208149888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586956.293619:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208149888:0@lo:13: 00000001:00080000:0.0:1788586956.393712:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788586956.488587:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586957.507175:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586958.531974:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586959.556733:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586960.579525:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586960.852982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586960.853029:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181911168 00000100:00100000:3.0:1788586960.853043:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181911168 00000100:00100000:3.0:1788586960.853280:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:3.0:1788586960.853289:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875469181911168:12345-192.168.204.28@tcp:250: 00010000:00080000:3.0:1788586960.853322:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 40a7953b-abbc-46ff-aa91-a0ba19d02562@192.168.204.28@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1788586960.853351:0:5845:0:(genops.c:1385:class_connect()) connect: client 40a7953b-abbc-46ff-aa91-a0ba19d02562, cookie 0xc1a730b05ab88a02 00000100:00080000:3.0:1788586960.853493:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8bacbf559800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586960.853573:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+5:2358:x1875469181911168:12345-192.168.204.28@tcp:250: Request processed in 284us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.853582:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:2.0:1788586960.877348:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586960.877467:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181911296 00000100:00100000:1.0:1788586960.877479:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181911296 00000100:00100000:1.0:1788586960.877550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:1.0:1788586960.877562:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+5:5591:x1875469181911296:12345-192.168.204.28@tcp:101: 00010000:00010000:1.0:1788586960.877585:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586960.877611:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c260f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586960.877647:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586960.877659:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586960.877668:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050e00, rc 0) 00000100:00100000:1.0:1788586960.878055:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+6:5591:x1875469181911296:12345-192.168.204.28@tcp:101: Request processed in 492us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586960.878064:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:2.0:1788586960.892364:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586960.892450:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181911424 00000100:00100000:3.0:1788586960.892460:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181911424 00000100:00100000:3.0:1788586960.892529:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:3.0:1788586960.892541:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+6:5591:x1875469181911424:12345-192.168.204.28@tcp:501: 00000100:00100000:3.0:1788586960.892988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+6:5591:x1875469181911424:12345-192.168.204.28@tcp:501: Request processed in 448us (631us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788586960.892997:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:2.0:1788586960.894936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586960.895280:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181911552 00000100:00100000:0.0:1788586960.895289:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181911552 00000100:00100000:0.0:1788586960.895352:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:0.0:1788586960.895363:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+6:5591:x1875469181911552:12345-192.168.204.28@tcp:101: 00010000:00010000:0.0:1788586960.895379:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586960.895400:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2616 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586960.895433:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586960.895445:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586960.895455:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac80030400, rc 0) 00000100:00100000:0.0:1788586960.895519:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+7:5591:x1875469181911552:12345-192.168.204.28@tcp:101: Request processed in 158us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586960.895526:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:3.0:1788586960.899080:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586960.899372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181911680 00000100:00100000:1.0:1788586960.899397:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181911680 00000100:00100000:1.0:1788586960.899448:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:1.0:1788586960.899458:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+7:5591:x1875469181911680:12345-192.168.204.28@tcp:501: 00000100:00100000:1.0:1788586960.899816:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5591:x1875469181911680:12345-192.168.204.28@tcp:501: Request processed in 358us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586960.899825:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:3.0:1788586960.900126:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208150144:0@lo:400: 00000100:00100000:3.0:1788586960.900195:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586960.900263:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208150656:0@lo:400: 00000100:00100000:3.0:1788586960.900297:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586960.900330:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788586960.900337:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208150016:0@lo:400: 00000100:00100000:3.0:1788586960.900363:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586960.900382:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208150528:0@lo:400: 00000100:00100000:3.0:1788586960.900402:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586960.900431:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208150272:0@lo:400: 00000100:00100000:3.0:1788586960.900454:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586960.900483:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586960.900488:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208150400:0@lo:400: 00000100:00100000:3.0:1788586960.900510:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586960.900551:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150144 00000100:00100000:3.0:1788586960.900557:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150144 00000100:00100000:3.0:1788586960.900595:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150528 00000100:00100000:3.0:1788586960.900598:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150528 00000100:00100000:3.0:1788586960.900624:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150272 00000100:00100000:3.0:1788586960.900627:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150272 00000100:00100000:3.0:1788586960.900643:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586960.900651:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208150144:12345-0@lo:400: 00000100:00100000:3.0:1788586960.900702:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208150144:12345-0@lo:400: Request processed in 51us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.900708:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586960.900723:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586960.900730:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208150528:12345-0@lo:400: 00000100:00100000:3.0:1788586960.900756:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208150528:12345-0@lo:400: Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.900762:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586960.900772:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586960.900777:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208150272:12345-0@lo:400: 00000100:00100000:3.0:1788586960.900804:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208150272:12345-0@lo:400: Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.900809:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586960.900827:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150656 00000100:00100000:3.0:1788586960.901362:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150656 00000100:00100000:3.0:1788586960.901401:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150400 00000100:00100000:3.0:1788586960.901403:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150400 00000100:00100000:3.0:1788586960.901417:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788586960.901430:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208150656:12345-0@lo:400: 00000100:00100000:3.0:1788586960.901465:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208150656:12345-0@lo:400: Request processed in 37us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.901472:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788586960.901483:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788586960.901489:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208150400:12345-0@lo:400: 00000100:00100000:3.0:1788586960.901513:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208150400:12345-0@lo:400: Request processed in 25us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.901518:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788586960.901552:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788586960.901557:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586960.901559:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788586960.901591:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44fa300 x1875469208150400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586960.901606:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208150400:0@lo:400: 00010000:00080000:3.0:1788586960.901619:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44faa00 x1875469208150272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586960.901626:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208150272:0@lo:400: 00010000:00080000:3.0:1788586960.901659:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44fa680 x1875469208150528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586960.901668:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208150528:0@lo:400: 00010000:00080000:3.0:1788586960.901680:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44f9880 x1875469208150144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586960.901688:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208150144:0@lo:400: 00010000:00080000:3.0:1788586960.901698:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44f9f80 x1875469208150656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586960.901712:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788586960.901723:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208150656:0@lo:400: 00000100:00100000:3.0:1788586960.901745:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150016 00000100:00100000:3.0:1788586960.901748:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150016 00000100:00100000:3.0:1788586960.901773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788586960.901778:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208150016:12345-0@lo:400: 00000100:00100000:3.0:1788586960.901811:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208150016:12345-0@lo:400: Request processed in 33us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.901817:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788586960.902347:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208150016:0@lo:400: 00000100:00100000:1.0:1788586960.903712:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208150784:0@lo:13: 00000100:00100000:1.0:1788586960.903785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586960.904120:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150784 00000100:00100000:2.0:1788586960.904129:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150784 00000100:00100000:2.0:1788586960.904185:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586960.904193:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208150784:12345-0@lo:13: 00002000:00000024:2.0:1788586960.904225:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586960.906121:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208150784:12345-0@lo:13: Request processed in 1919us (2326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586960.906135:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788586960.910029:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586960.910330:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181911808 00000100:00100000:0.0:1788586960.910353:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181911808 00000100:00100000:0.0:1788586960.910414:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:0.0:1788586960.910425:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5591:x1875469181911808:12345-192.168.204.28@tcp:503: 00000100:00100000:0.0:1788586960.910757:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5591:x1875469181911808:12345-192.168.204.28@tcp:503: Request processed in 333us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586960.910780:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 119 00010000:00080000:1.0:1788586960.918018:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d83800 x1875469208150784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586960.918057:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208150784:0@lo:13: 00000100:00100000:2.0:1788586960.921166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586960.921263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181911936 00000100:00100000:1.0:1788586960.921274:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181911936 00000100:00100000:1.0:1788586960.921328:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:1.0:1788586960.921339:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5609:x1875469181911936:12345-192.168.204.28@tcp:502: 00000100:00100000:1.0:1788586960.921703:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5609:x1875469181911936:12345-192.168.204.28@tcp:502: Request processed in 364us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586960.921711:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:3.0:1788586960.980224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586960.980380:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912064 00000100:00100000:1.0:1788586960.980393:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912064 00000100:00100000:1.0:1788586960.980458:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:1.0:1788586960.980469:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5609:x1875469181912064:12345-192.168.204.28@tcp:502: 00000100:00100000:1.0:1788586960.980802:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5609:x1875469181912064:12345-192.168.204.28@tcp:502: Request processed in 333us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586960.980812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:2.0:1788586960.990098:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586960.991710:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912192 00000100:00100000:3.0:1788586960.991725:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912192 00000100:00100000:3.0:1788586960.991788:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:3.0:1788586960.991800:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5591:x1875469181912192:12345-192.168.204.28@tcp:101: 00010000:00010000:3.0:1788586960.991820:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586960.991838:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab88a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2640 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586960.991896:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab88a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2640 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586960.992287:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab88a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2640 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586960.992298:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4400, rc 0) 00000100:00100000:3.0:1788586960.992386:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5591:x1875469181912192:12345-192.168.204.28@tcp:101: Request processed in 588us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586960.992394:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:2.0:1788586960.998305:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586960.998360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912320 00000100:00100000:3.0:1788586960.998371:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912320 00000100:00100000:3.0:1788586960.998428:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:3.0:1788586960.998438:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5591:x1875469181912320:12345-192.168.204.28@tcp:256: 20000000:01000000:3.0:1788586960.998464:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788586960.998487:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788586960.998491:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788586960.998494:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788586960.998496:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788586961.002468:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5591:x1875469181912320:12345-192.168.204.28@tcp:256: Request processed in 4018us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586961.002488:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:2.0:1788586961.005946:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586961.006084:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912448 00000100:00100000:2.0:1788586961.006094:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912448 00000100:00100000:2.0:1788586961.006147:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:2.0:1788586961.006158:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5591:x1875469181912448:12345-192.168.204.28@tcp:101: 00010000:00010000:2.0:1788586961.006178:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586961.006204:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2647 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586961.006319:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586961.006335:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586961.006349:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5600, rc 0) 00000100:00100000:2.0:1788586961.006409:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5591:x1875469181912448:12345-192.168.204.28@tcp:101: Request processed in 253us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586961.006420:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:2.0:1788586961.011191:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586961.012642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912576 00000100:00100000:1.0:1788586961.012746:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912576 00000100:00100000:1.0:1788586961.012817:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:1.0:1788586961.012829:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5591:x1875469181912576:12345-192.168.204.28@tcp:501: 00000100:00100000:1.0:1788586961.013512:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5591:x1875469181912576:12345-192.168.204.28@tcp:501: Request processed in 678us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586961.013524:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:2.0:1788586961.018302:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586961.018747:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912704 00000100:00100000:0.0:1788586961.018757:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912704 00000100:00100000:0.0:1788586961.018811:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:0.0:1788586961.018822:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5591:x1875469181912704:12345-192.168.204.28@tcp:503: 00000100:00100000:0.0:1788586961.019636:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5591:x1875469181912704:12345-192.168.204.28@tcp:503: Request processed in 812us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586961.019647:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:3.0:1788586961.024194:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586961.024909:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912832 00000100:00100000:0.0:1788586961.024920:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912832 00000100:00100000:0.0:1788586961.025160:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:0.0:1788586961.025172:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5613:x1875469181912832:12345-192.168.204.28@tcp:502: 00000100:00100000:0.0:1788586961.025487:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5613:x1875469181912832:12345-192.168.204.28@tcp:502: Request processed in 316us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586961.025496:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:1.0:1788586961.028572:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586961.028630:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181912960 00000100:00100000:2.0:1788586961.028640:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181912960 00000100:00100000:2.0:1788586961.028742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:2.0:1788586961.028755:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5613:x1875469181912960:12345-192.168.204.28@tcp:502: 00000100:00100000:2.0:1788586961.029062:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5613:x1875469181912960:12345-192.168.204.28@tcp:502: Request processed in 309us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586961.029079:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:0.0:1788586961.037438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586961.037481:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913088 00000100:00100000:0.0:1788586961.037490:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913088 00000100:00100000:0.0:1788586961.037531:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1788586961.037540:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875469181913088:12345-192.168.204.28@tcp:38: 00010000:00080000:0.0:1788586961.037570:0:5851:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:0.0:1788586961.037625:0:5851:0:(genops.c:1385:class_connect()) connect: client 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8, cookie 0xc1a730b05ab88a25 00000004:00100000:0.0:1788586961.037658:0:5851:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788586961.037666:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788586961.084453:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8bacbf719000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788586961.084581:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2358:x1875469181913088:12345-192.168.204.28@tcp:38: Request processed in 47040us (47155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586961.084593:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1788586961.411039:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586961.411094:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208150912:0@lo:13: 00000100:00100000:2.0:1788586961.411164:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586961.411232:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208150912 00000100:00100000:2.0:1788586961.411239:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208150912 00000100:00100000:2.0:1788586961.411287:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788586961.411297:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208150912:12345-0@lo:13: 00002000:00000024:2.0:1788586961.411327:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586961.411374:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208150912:12345-0@lo:13: Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586961.411381:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788586961.411423:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d81880 x1875469208150912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586961.411442:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208150912:0@lo:13: 00010000:00010000:1.0:1788586961.603166:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586962.104279:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586962.104446:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913344 00000100:00100000:3.0:1788586962.104458:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913344 00000100:00100000:3.0:1788586962.104551:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1788586962.104563:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5591:x1875469181913344:12345-192.168.204.28@tcp:41: 00000004:00000024:3.0:1788586962.104621:0:7662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788586962.104693:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5591:x1875469181913344:12345-192.168.204.28@tcp:41: Request processed in 133us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586962.104702:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00080000:1.0:1788586962.104782:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788586962.111546:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586962.117233:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586962.122867:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913472 00000100:00100000:0.0:1788586962.122892:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913472 00000100:00100000:0.0:1788586962.123033:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913216 00000100:00100000:0.0:1788586962.123038:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913216 00000100:00100000:0.0:1788586962.123080:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:0.0:1788586962.123094:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:5591:x1875469181913472:12345-192.168.204.28@tcp:40: 00000100:00100000:0.0:1788586962.123249:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:5591:x1875469181913472:12345-192.168.204.28@tcp:40: Request processed in 157us (11722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586962.123257:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:0.0:1788586962.123278:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:0.0:1788586962.123286:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:0:x1875469181913216:12345-192.168.204.28@tcp:41: 00000004:00000024:0.0:1788586962.123303:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788586962.123339:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:0:x1875469181913216:12345-192.168.204.28@tcp:41: Request processed in 54us (6123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586962.123345:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1788586962.126239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586962.126420:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913856 00000100:00100000:0.0:1788586962.126433:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913856 00000100:00100000:0.0:1788586962.126489:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1788586962.126501:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5591:x1875469181913856:12345-192.168.204.28@tcp:33: 00000100:00100000:2.0:1788586962.146812:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586962.146880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586962.146925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586962.147108:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913600 00000100:00100000:3.0:1788586962.147124:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913600 00000100:00100000:3.0:1788586962.147185:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913728 00000100:00100000:3.0:1788586962.147188:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913728 00000100:00100000:3.0:1788586962.147241:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788586962.147252:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875469181913600:12345-192.168.204.28@tcp:8: 00010000:00080000:3.0:1788586962.147308:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:3.0:1788586962.147363:0:6707:0:(genops.c:1385:class_connect()) connect: client 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8, cookie 0xc1a730b05ab88a2c 00002000:00100000:3.0:1788586962.147381:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8/ffff8bacbf55e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788586962.147398:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788586962.147921:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788586962.148397:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181913984 00000100:00100000:2.0:1788586962.148407:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181913984 00000100:00100000:2.0:1788586962.148471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:2.0:1788586962.148482:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2361:x1875469181913984:12345-192.168.204.28@tcp:400: 00000100:00100000:2.0:1788586962.148582:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2361:x1875469181913984:12345-192.168.204.28@tcp:400: Request processed in 102us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586962.148591:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00080000:3.0:1788586962.149748:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bacbf55d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586962.149832:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2358:x1875469181913600:12345-192.168.204.28@tcp:8: Request processed in 2576us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586962.149858:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788586962.149900:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1788586962.149908:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875469181913728:12345-192.168.204.28@tcp:8: 00010000:00080000:3.0:1788586962.149944:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:3.0:1788586962.153508:0:6707:0:(genops.c:1385:class_connect()) connect: client 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8, cookie 0xc1a730b05ab88a33 00002000:00100000:3.0:1788586962.153545:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8/ffff8bacbf55a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788586962.153568:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788586962.154124:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788586962.154192:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bac92c38000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788586962.154322:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2358:x1875469181913728:12345-192.168.204.28@tcp:8: Request processed in 4411us (7439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586962.154335:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000004:00080000:2.0:1788586962.179288:0:5853:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 52514us 00000004:00200000:0.0:1788586962.216131:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788586962.216312:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5591:x1875469181913856:12345-192.168.204.28@tcp:33: Request processed in 89805us (90078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586962.216326:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1788586962.555420:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586962.555772:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181914112 00000100:00100000:0.0:1788586962.555788:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181914112 00000100:00100000:0.0:1788586962.555964:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:0.0:1788586962.555977:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5631:x1875469181914112:12345-192.168.204.28@tcp:101: 00010000:00010000:0.0:1788586962.556009:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586962.556062:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab88a3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2671 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586962.556192:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88a41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586962.556216:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88a41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586962.556238:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88a41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788586962.556419:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788586962.556425:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788586962.556448:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88a41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586962.556557:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab88a3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2671 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586962.556617:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88a41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2671 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586962.556628:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac90439800) 00010000:00010000:0.0:1788586962.556632:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788586962.556637:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788586962.556812:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:5631:x1875469181914112:12345-192.168.204.28@tcp:101: Request processed in 836us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586962.556821:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00010000:00010000:3.0:1788586962.627639:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586963.652217:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586964.675341:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586965.069000:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586965.074742:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181914240 00000100:00100000:2.0:1788586965.074761:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181914240 00000100:00100000:2.0:1788586965.075130:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:2.0:1788586965.075146:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:5683:x1875469181914240:12345-192.168.204.28@tcp:41: 00000004:00000024:2.0:1788586965.075197:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788586965.075287:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:5683:x1875469181914240:12345-192.168.204.28@tcp:41: Request processed in 146us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.075294:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00080000:1.0:1788586965.075487:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586965.083280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586965.083402:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181914368 00000100:00100000:0.0:1788586965.083546:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181914368 00000100:00080000:1.0:1788586965.084010:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788586965.084136:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1788586965.084151:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5683:x1875469181914368:12345-192.168.204.28@tcp:13: 00002000:00000024:0.0:1788586965.084196:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788586965.084277:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5683:x1875469181914368:12345-192.168.204.28@tcp:13: Request processed in 130us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586965.084284:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788586965.093020:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586965.093253:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181914496 00000100:00100000:2.0:1788586965.093264:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181914496 00000100:00100000:2.0:1788586965.093342:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:2.0:1788586965.093352:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5683:x1875469181914496:12345-192.168.204.28@tcp:13: 00002000:00000024:2.0:1788586965.093397:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586965.093477:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:5683:x1875469181914496:12345-192.168.204.28@tcp:13: Request processed in 126us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586965.093483:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00080000:1.0:1788586965.093702:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788586965.699228:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586966.020875:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208151168:0@lo:400: 00000100:00100000:0.0:1788586966.020960:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586966.021028:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208151680:0@lo:400: 00000100:00100000:0.0:1788586966.021054:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586966.021089:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788586966.021096:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208151040:0@lo:400: 00000100:00100000:0.0:1788586966.021125:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586966.021160:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208151552:0@lo:400: 00000100:00100000:0.0:1788586966.021185:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586966.021214:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208151296:0@lo:400: 00000100:00100000:0.0:1788586966.021236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586966.022432:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208151424:0@lo:400: 00000100:00100000:1.0:1788586966.022482:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586966.022693:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151168 00000100:00100000:0.0:1788586966.022704:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151168 00000100:00100000:0.0:1788586966.022765:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151552 00000100:00100000:0.0:1788586966.022769:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151552 00000100:00100000:0.0:1788586966.022794:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151296 00000100:00100000:0.0:1788586966.022798:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151296 00000100:00100000:0.0:1788586966.022818:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788586966.022827:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208151168:12345-0@lo:400: 00000100:00100000:0.0:1788586966.022906:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208151168:12345-0@lo:400: Request processed in 80us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586966.022914:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788586966.022930:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788586966.022936:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208151552:12345-0@lo:400: 00000100:00100000:0.0:1788586966.022962:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208151552:12345-0@lo:400: Request processed in 28us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586966.022968:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788586966.022992:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788586966.022998:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208151296:12345-0@lo:400: 00000100:00100000:0.0:1788586966.023027:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208151296:12345-0@lo:400: Request processed in 30us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586966.023033:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788586966.023051:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151680 00000100:00100000:0.0:1788586966.023055:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151680 00000100:00100000:0.0:1788586966.023095:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151424 00000100:00100000:0.0:1788586966.023098:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151424 00000100:00100000:0.0:1788586966.023112:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586966.023118:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208151680:12345-0@lo:400: 00000100:00100000:0.0:1788586966.023151:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208151680:12345-0@lo:400: Request processed in 33us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586966.023157:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788586966.023168:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788586966.023174:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208151424:12345-0@lo:400: 00000100:00100000:0.0:1788586966.023205:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208151424:12345-0@lo:400: Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586966.023211:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788586966.023237:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788586966.023241:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586966.023244:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788586966.023281:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83052680 x1875469208151424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586966.023300:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208151424:0@lo:400: 00000100:00100000:0.0:1788586966.023338:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208151552:0@lo:400: 00000100:00100000:0.0:1788586966.023351:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208151168:0@lo:400: 00010000:00080000:0.0:1788586966.023362:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83053b80 x1875469208151680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586966.023372:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208151680:0@lo:400: 00000100:00100000:0.0:1788586966.023400:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208151296:0@lo:400: 00000100:00100000:2.0:1788586966.024937:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151040 00000100:00100000:2.0:1788586966.024951:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151040 00000100:00100000:2.0:1788586966.025012:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788586966.025022:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208151040:12345-0@lo:400: 00000100:00100000:2.0:1788586966.025093:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208151040:12345-0@lo:400: Request processed in 73us (3966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586966.025101:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788586966.029006:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788586966.029053:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208151808:0@lo:13: 00000100:00100000:0.0:1788586966.029127:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586966.029263:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208151040:0@lo:400: 00000100:00100000:3.0:1788586966.037715:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151808 00000100:00100000:3.0:1788586966.037730:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151808 00000100:00100000:3.0:1788586966.037897:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788586966.037908:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208151808:12345-0@lo:13: 00002000:00000024:3.0:1788586966.037933:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788586966.038033:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208151808:12345-0@lo:13: Request processed in 127us (8906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586966.038041:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788586966.038092:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d80e00 x1875469208151808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586966.038116:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208151808:0@lo:13: 00000001:00100000:1.0:1788586966.139178:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000100:00100000:0.0:1788586966.531195:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586966.531228:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208151936:0@lo:13: 00000100:00100000:0.0:1788586966.531305:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586966.531433:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208151936 00000100:00100000:2.0:1788586966.531443:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208151936 00000100:00100000:2.0:1788586966.531504:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788586966.531522:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208151936:12345-0@lo:13: 00002000:00000024:2.0:1788586966.531554:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586966.531614:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208151936:12345-0@lo:13: Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586966.531622:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788586966.532067:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d80e00 x1875469208151936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586966.532088:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208151936:0@lo:13: 00000001:00100000:1.0:1788586966.586380:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000001:00100000:0.0:1788586966.599831:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00010000:00010000:3.0:1788586966.725342:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586967.575171:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586967.575213:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586967.575251:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586967.575293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586967.575326:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181914880 00000100:00100000:0.0:1788586967.575338:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181914880 00000100:00100000:0.0:1788586967.575408:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915008 00000100:00100000:0.0:1788586967.575412:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915008 00000100:00100000:0.0:1788586967.575432:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1788586967.575443:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181914880:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788586967.575526:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181914880:12345-192.168.204.28@tcp:400: Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.575534:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1788586967.575553:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1788586967.575561:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181915008:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788586967.575586:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181915008:12345-192.168.204.28@tcp:400: Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586967.575593:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00080000:0.0:1788586967.575609:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586967.575627:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788586967.579317:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181914624 00000100:00100000:2.0:1788586967.579337:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181914624 00000100:00100000:2.0:1788586967.579414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:2.0:1788586967.579424:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2362:x1875469181914624:12345-192.168.204.28@tcp:400: 00000100:00100000:2.0:1788586967.579509:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2362:x1875469181914624:12345-192.168.204.28@tcp:400: Request processed in 87us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586967.579518:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:3.0:1788586967.580266:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181914752 00000100:00100000:3.0:1788586967.580274:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181914752 00000100:00100000:3.0:1788586967.580349:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:3.0:1788586967.580358:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181914752:12345-192.168.204.28@tcp:400: 00000100:00100000:3.0:1788586967.580407:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181914752:12345-192.168.204.28@tcp:400: Request processed in 51us (5156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586967.580415:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00080000:1.0:1788586967.580594:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788586967.748525:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586968.220110:0:8320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788586968.771146:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586969.796606:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586970.820494:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586971.140012:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208152064:0@lo:400: 00000100:00100000:0.0:1788586971.140085:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586971.140136:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208152576:0@lo:400: 00000100:00100000:0.0:1788586971.140162:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586971.140189:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788586971.140194:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208152192:0@lo:400: 00000100:00100000:0.0:1788586971.140215:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586971.140232:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208152704:0@lo:400: 00000100:00100000:0.0:1788586971.140256:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586971.140286:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208152320:0@lo:400: 00000100:00100000:0.0:1788586971.140309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586971.140328:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586971.140333:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208152448:0@lo:400: 00000100:00100000:0.0:1788586971.140353:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586971.140388:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152576 00000100:00100000:0.0:1788586971.140398:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152576 00000100:00100000:0.0:1788586971.140451:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152192 00000100:00100000:0.0:1788586971.140454:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152192 00000100:00100000:0.0:1788586971.140467:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152320 00000100:00100000:0.0:1788586971.140470:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152320 00000100:00100000:0.0:1788586971.140487:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788586971.140497:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208152576:12345-0@lo:400: 00000100:00100000:0.0:1788586971.140547:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208152576:12345-0@lo:400: Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586971.140554:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788586971.140572:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788586971.140578:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208152192:12345-0@lo:400: 00000100:00100000:0.0:1788586971.140612:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208152192:12345-0@lo:400: Request processed in 35us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586971.140619:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788586971.140631:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788586971.140653:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208152320:12345-0@lo:400: 00000100:00100000:0.0:1788586971.140684:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208152320:12345-0@lo:400: Request processed in 48us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586971.140690:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788586971.140713:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152704 00000100:00100000:0.0:1788586971.140716:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152704 00000100:00100000:0.0:1788586971.140741:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152448 00000100:00100000:0.0:1788586971.140744:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152448 00000100:00100000:0.0:1788586971.140758:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788586971.140764:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208152704:12345-0@lo:400: 00000100:00100000:0.0:1788586971.140793:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208152704:12345-0@lo:400: Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586971.140799:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788586971.140810:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586971.140815:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208152448:12345-0@lo:400: 00000100:00100000:0.0:1788586971.140840:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208152448:12345-0@lo:400: Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586971.140869:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788586971.140901:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788586971.140905:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586971.140908:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788586971.141025:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbb66e300 x1875469208152448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586971.141050:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208152448:0@lo:400: 00000100:00100000:0.0:1788586971.141064:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208152320:0@lo:400: 00000100:00100000:0.0:1788586971.141092:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208152192:0@lo:400: 00010000:00080000:0.0:1788586971.141102:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbb66c700 x1875469208152704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586971.141110:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208152704:0@lo:400: 00000100:00100000:0.0:1788586971.141119:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208152576:0@lo:400: 00000100:00100000:2.0:1788586971.141427:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152064 00000100:00100000:2.0:1788586971.141432:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152064 00000100:00100000:2.0:1788586971.141471:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788586971.141479:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208152064:12345-0@lo:400: 00000100:00100000:2.0:1788586971.141523:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208152064:12345-0@lo:400: Request processed in 45us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586971.141529:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788586971.141760:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208152064:0@lo:400: 00000100:00100000:1.0:1788586971.151255:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788586971.151293:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208152832:0@lo:13: 00000100:00100000:1.0:1788586971.151384:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586971.151730:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152832 00000100:00100000:0.0:1788586971.151739:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152832 00000100:00100000:0.0:1788586971.151805:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586971.151815:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208152832:12345-0@lo:13: 00002000:00000024:0.0:1788586971.151894:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788586971.151947:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208152832:12345-0@lo:13: Request processed in 134us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586971.151955:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788586971.156439:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadd880 x1875469208152832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586971.156736:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208152832:0@lo:13: 00000100:00100000:2.0:1788586971.653452:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586971.653488:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208152960:0@lo:13: 00000100:00100000:2.0:1788586971.653592:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586971.653683:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208152960 00000100:00100000:2.0:1788586971.653692:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208152960 00000100:00100000:2.0:1788586971.653742:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788586971.653751:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208152960:12345-0@lo:13: 00002000:00000024:2.0:1788586971.653798:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586971.653882:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208152960:12345-0@lo:13: Request processed in 132us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586971.653889:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788586971.653931:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d83800 x1875469208152960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586971.653951:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208152960:0@lo:13: 00010000:00010000:2.0:1788586971.843907:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586972.695633:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586972.695971:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586972.696007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586972.696035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586972.696065:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915136 00000100:00100000:0.0:1788586972.696078:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915136 00000100:00100000:0.0:1788586972.696188:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:0.0:1788586972.696202:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2362:x1875469181915136:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788586972.696323:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2362:x1875469181915136:12345-192.168.204.28@tcp:400: Request processed in 124us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.696332:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:0.0:1788586972.703623:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915392 00000100:00100000:0.0:1788586972.703644:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915392 00000100:00100000:0.0:1788586972.703742:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915520 00000100:00100000:0.0:1788586972.703746:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915520 00000100:00100000:0.0:1788586972.703775:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1788586972.703786:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181915392:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788586972.703919:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181915392:12345-192.168.204.28@tcp:400: Request processed in 134us (7947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.703927:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1788586972.703946:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:0.0:1788586972.703953:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181915520:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788586972.703979:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181915520:12345-192.168.204.28@tcp:400: Request processed in 28us (7945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.703985:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:0.0:1788586972.704006:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915264 00000100:00100000:0.0:1788586972.704010:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915264 00000100:00100000:0.0:1788586972.704043:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:0.0:1788586972.704049:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181915264:12345-192.168.204.28@tcp:400: 00000100:00100000:0.0:1788586972.704077:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181915264:12345-192.168.204.28@tcp:400: Request processed in 30us (8070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.704084:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00080000:2.0:1788586972.704572:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788586972.704578:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788586972.704580:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788586972.784536:0:8469:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc37b99730 20000000:00000080:2.0:1788586972.784564:0:8469:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bac882f3800 uarg=0000000000000000 20000000:01000000:2.0:1788586972.784616:0:8469:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788586972.784619:0:8469:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788586972.784622:0:8469:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788586972.784628:0:8469:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788586972.784636:0:8469:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788586972.784658:0:8469:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788586972.784661:0:8469:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788586972.786580:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788586972.786590:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788586972.788768:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788586972.793982:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788586972.794399:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788586972.794574:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788586972.794606:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788586972.794609:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788586972.798147:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788586972.799557:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788586972.799649:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788586972.799705:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788586972.799728:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788586972.799732:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788586972.801713:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788586972.803308:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788586972.803377:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788586972.803433:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788586972.803450:0:8469:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788586972.803453:0:8469:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788586972.805762:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788586972.808403:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788586972.808527:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788586972.808569:0:8469:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788586972.808596:0:8469:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788586972.808626:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808654:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808663:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808671:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808678:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808684:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808692:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808699:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808711:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808739:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808747:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808803:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.808824:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 9 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.809342:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153088:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788586972.809504:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.809515:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 9 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.809525:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153216:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788586972.809563:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.809572:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 18 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.809581:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153344:0@lo:104: 00000100:00100000:2.0:1788586972.809635:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586972.809699:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.809709:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 18 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.809718:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153472:0@lo:104: 00000100:00100000:2.0:1788586972.809751:0:8469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586972.815106:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.815150:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 18 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.815175:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153600:0@lo:104: 00010000:00010000:3.0:1788586972.815740:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586972.815752:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 18 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586972.815761:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153728:0@lo:104: 00010000:00010000:3.0:1788586972.815782:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586972.815790:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 18 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586972.815798:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153856:0@lo:104: 00010000:00010000:3.0:1788586972.815830:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586972.815838:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 18 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586972.816152:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153984:0@lo:104: 00010000:00010000:3.0:1788586972.816188:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586972.816197:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 18 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586972.816236:0:8469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208154112:0@lo:104: 00000100:00100000:3.0:1788586972.816262:0:8469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004240 going to sleep for 11 seconds 00000100:00100000:0.0:1788586972.817531:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788586972.817584:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.817621:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.817633:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.817642:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.817652:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.817663:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208153344 00000100:00100000:0.0:1788586972.817673:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208153344 00000100:00100000:0.0:1788586972.817737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208153472 00000100:00100000:0.0:1788586972.817741:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208153472 00000100:00100000:0.0:1788586972.817754:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208153600 00000100:00100000:0.0:1788586972.817757:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208153600 00000100:00100000:0.0:1788586972.817767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208153728 00000100:00100000:0.0:1788586972.817769:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208153728 00000100:00100000:0.0:1788586972.817779:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208153856 00000100:00100000:0.0:1788586972.817782:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208153856 00000100:00100000:0.0:1788586972.817823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208153984 00000100:00100000:0.0:1788586972.817826:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208153984 00000100:00100000:0.0:1788586972.817837:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208154112 00000100:00100000:0.0:1788586972.817840:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208154112 00000100:00100000:0.0:1788586972.817895:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586972.817905:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:8469:x1875469208153344:12345-0@lo:104: 00010000:00010000:0.0:1788586972.817926:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.818021:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586972.818028:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+9:8469:x1875469208153344:12345-0@lo:104: Request processed in 125us (8395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.818036:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586972.818057:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586972.818063:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+8:8469:x1875469208153472:12345-0@lo:104: 00010000:00010000:0.0:1788586972.818083:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.818119:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788586972.818125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b8d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+8:8469:x1875469208153472:12345-0@lo:104: Request processed in 63us (8374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.818131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586972.818179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586972.818185:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+7:8469:x1875469208153600:12345-0@lo:104: 00010000:00010000:0.0:1788586972.818193:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.818219:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788586972.818225:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+7:8469:x1875469208153600:12345-0@lo:104: Request processed in 40us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.818231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788586972.818242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586972.818248:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+6:8469:x1875469208153728:12345-0@lo:104: 00010000:00010000:0.0:1788586972.818255:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.818280:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788586972.818285:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+6:8469:x1875469208153728:12345-0@lo:104: Request processed in 38us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.818290:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788586972.818300:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788586972.818306:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:8469:x1875469208153856:12345-0@lo:104: 00010000:00010000:0.0:1788586972.818321:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.818351:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788586972.818356:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+5:8469:x1875469208153856:12345-0@lo:104: Request processed in 50us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.818362:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788586972.818375:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788586972.818381:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:8469:x1875469208153984:12345-0@lo:104: 00010000:00010000:0.0:1788586972.818389:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.818416:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788586972.818421:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:8469:x1875469208153984:12345-0@lo:104: Request processed in 41us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.818426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788586972.818438:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586972.818443:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8469:x1875469208154112:12345-0@lo:104: 00010000:00010000:0.0:1788586972.818450:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.818476:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788586972.818481:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8469:x1875469208154112:12345-0@lo:104: Request processed in 38us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.818487:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788586972.819641:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788586972.819657:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819669:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5c00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586972.819674:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819685:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586972.819694:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586972.819701:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586972.819789:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819797:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586972.819829:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819837:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5c00/0xc1a730b05ab889f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889fb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819903:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788586972.819907:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819913:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050a00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586972.819915:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819921:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586972.819927:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586972.819932:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586972.819948:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819955:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586972.819960:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819977:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc2050a00/0xc1a730b05ab889ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889d1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819988:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788586972.819991:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.819997:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4600 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586972.820000:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820009:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586972.820015:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586972.820020:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586972.820054:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820062:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586972.820082:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820088:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c4600/0xc1a730b05ab889ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889b5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820100:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788586972.820111:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820116:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac80030e00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586972.820118:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820125:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586972.820130:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586972.820135:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586972.820151:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820158:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586972.820163:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820169:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac80030e00/0xc1a730b05ab889a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab889a7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820181:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788586972.820184:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820191:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586972.820194:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820213:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586972.820220:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586972.820226:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586972.820241:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820247:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586972.820251:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820258:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc2050200/0xc1a730b05ab88992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88999 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820269:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788586972.820272:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820277:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5e00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586972.820280:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820288:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586972.820294:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586972.820307:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586972.820324:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820330:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586972.820335:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820342:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5e00/0xc1a730b05ab88968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab8896f expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820351:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788586972.820354:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820360:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051c00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788586972.820363:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820369:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788586972.820375:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586972.820381:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788586972.820393:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820399:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788586972.820410:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820416:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc2051c00/0xc1a730b05ab8893e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88945 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.820432:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586972.820434:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586972.820437:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586972.820448:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586972.820482:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154240:0@lo:103: 00000100:00100000:2.0:1788586972.820572:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586972.820632:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154752:0@lo:103: 00000100:00100000:2.0:1788586972.820657:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586972.821180:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153344:0@lo:104: 00000100:00100000:3.0:1788586972.821194:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153472:0@lo:104: 00000100:00100000:3.0:1788586972.821205:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153600:0@lo:104: 00000100:00100000:3.0:1788586972.821214:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153728:0@lo:104: 00000100:00100000:3.0:1788586972.821224:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153856:0@lo:104: 00000100:00100000:3.0:1788586972.821233:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153984:0@lo:104: 00000100:00100000:3.0:1788586972.821243:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208154112:0@lo:104: 00000100:00100000:3.0:1788586972.821568:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208154624:0@lo:103: 00000100:00100000:3.0:1788586972.821617:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586972.821665:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788586972.821673:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208154496:0@lo:103: 00000100:00100000:3.0:1788586972.821695:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586972.821705:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208155008:0@lo:103: 00000100:00100000:3.0:1788586972.821722:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586972.821797:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208154240 00000100:00100000:0.0:1788586972.821807:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208154240 00010000:00010000:0.0:1788586972.822048:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586972.822079:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208154752 00000100:00100000:0.0:1788586972.822083:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208154752 00010000:00010000:0.0:1788586972.822098:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 20 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586972.822111:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208154624 00000100:00100000:0.0:1788586972.822114:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208154624 00010000:00010000:0.0:1788586972.822125:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 21 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586972.822136:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208154496 00000100:00100000:0.0:1788586972.822139:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208154496 00010000:00010000:0.0:1788586972.822152:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 22 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586972.822164:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155008 00000100:00100000:0.0:1788586972.822166:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155008 00010000:00010000:0.0:1788586972.822178:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 23 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586972.822194:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586972.822205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+23:3314:x1875469208154240:12345-0@lo:103: 00010000:00010000:0.0:1788586972.822224:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586972.822231:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 23 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.822243:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 23 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.822278:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc21c7000/0xc1a730b05ab889fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab889f4 expref: 23 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586972.822298:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586972.822350:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+22:3314:x1875469208154240:12345-0@lo:103: Request processed in 146us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586972.822357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788586972.822381:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788586972.822391:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+21:3314:x1875469208154752:12345-0@lo:103: 00010000:00010000:1.0:1788586972.822470:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586972.822480:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 21 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822491:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 21 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822504:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88992 expref: 21 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822514:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586972.822548:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+20:3314:x1875469208154752:12345-0@lo:103: Request processed in 159us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.822557:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788586972.822577:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788586972.822587:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208154624:12345-0@lo:103: 00000100:00100000:2.0:1788586972.822588:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:1.0:1788586972.822599:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586972.822605:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 19 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.822609:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154368:0@lo:103: 00010000:00010000:1.0:1788586972.822621:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 19 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822645:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80031600/0xc1a730b05ab889a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab889a0 expref: 19 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.822656:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788586972.822660:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586972.822686:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154880:0@lo:103: 00000100:00100000:1.0:1788586972.822696:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3313:x1875469208154624:12345-0@lo:103: Request processed in 112us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.822704:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788586972.822719:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208154368 00000100:00100000:2.0:1788586972.822720:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586972.822726:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208154368 00010000:00010000:1.0:1788586972.822746:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 18 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.822755:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154240:0@lo:103: 00000100:00100000:1.0:1788586972.822761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208154880 00000100:00100000:1.0:1788586972.822765:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208154880 00000100:00100000:2.0:1788586972.822770:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154752:0@lo:103: 00010000:00010000:1.0:1788586972.822779:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 19 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586972.822794:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788586972.822801:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208154496:12345-0@lo:103: 00010000:00010000:1.0:1788586972.822810:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586972.822815:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 19 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.822822:0:5835:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788586972.822825:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 19 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.822837:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788586972.822839:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80031800/0xc1a730b05ab889b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab889ae expref: 19 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822890:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586972.822913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3313:x1875469208154496:12345-0@lo:103: Request processed in 113us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.822920:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788586972.822935:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586972.822942:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3313:x1875469208155008:12345-0@lo:103: 00010000:00010000:1.0:1788586972.822950:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586972.822955:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 17 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822964:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 17 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822974:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050800/0xc1a730b05ab88945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab8893e expref: 17 pid: 5842 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.822983:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586972.823007:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3313:x1875469208155008:12345-0@lo:103: Request processed in 65us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.823014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788586972.823028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788586972.823035:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:3314:x1875469208154368:12345-0@lo:103: 00010000:00010000:1.0:1788586972.823043:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586972.823048:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 15 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.823057:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 15 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.823075:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab889d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab889ca expref: 15 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.823086:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788586972.823096:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208154496:0@lo:103: 00000100:00100000:3.0:1788586972.823109:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208155008:0@lo:103: 00000100:00100000:3.0:1788586972.823116:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208154624:0@lo:103: 00000100:00100000:1.0:1788586972.823134:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3314:x1875469208154368:12345-0@lo:103: Request processed in 98us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.823141:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788586972.823159:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788586972.823165:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88340050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:3314:x1875469208154880:12345-0@lo:103: 00010000:00010000:1.0:1788586972.823172:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586972.823178:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 13 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.823187:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 13 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586972.823190:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154368:0@lo:103: 00010000:00010000:1.0:1788586972.823208:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030600/0xc1a730b05ab8896f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88968 expref: 13 pid: 5844 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586972.823219:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586972.823263:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88340050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:3314:x1875469208154880:12345-0@lo:103: Request processed in 98us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586972.823270:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586972.823278:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208154880:0@lo:103: 00000100:00100000:3.0:1788586972.828546:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153088:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788586972.828571:0:8469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8469:1875469208153216:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788586972.828652:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586972.829492:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586972.829534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586972.829678:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915776 00000100:00100000:2.0:1788586972.829689:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915776 00010000:00010000:2.0:1788586972.829754:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 10 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.829813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915648 00000100:00100000:2.0:1788586972.829816:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915648 00010000:00010000:2.0:1788586972.829833:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 11 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586972.829892:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788586972.829902:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:2361:x1875469181915776:12345-192.168.204.28@tcp:103: 00010000:00010000:2.0:1788586972.829921:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586972.829929:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 11 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.829941:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 11 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.829964:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab88a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c260f expref: 11 pid: 5844 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.829984:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586972.830062:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2361:x1875469181915776:12345-192.168.204.28@tcp:103: Request processed in 161us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586972.830070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788586972.830090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1788586972.830096:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:2361:x1875469181915648:12345-192.168.204.28@tcp:103: 00010000:00010000:2.0:1788586972.830105:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788586972.830109:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 9 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830131:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 9 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830142:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030400/0xc1a730b05ab88a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2616 expref: 9 pid: 5845 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830155:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830164:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830184:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830193:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830201:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830209:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830215:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788586972.830220:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830229:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830254:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586972.830265:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788586972.830287:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:2361:x1875469181915648:12345-192.168.204.28@tcp:103: Request processed in 191us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586972.830294:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00010000:00010000:3.0:1788586972.830731:0:8469:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586972.830743:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586972.830749:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5e00/0xc1a730b05ab88a48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586972.871607:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586973.895621:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788586973.955675:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788586973.955689:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bacbb896000 from 39 10000000:01000000:0.0:1788586973.955700:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788586973.955780:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.955796:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.955916:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586973.955949:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155136:0@lo:101: 00000100:00100000:0.0:1788586973.956050:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.956155:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.956263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155136 00000100:00100000:2.0:1788586973.956275:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155136 00000100:00100000:2.0:1788586973.956403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788586973.956414:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+12:5847:x1875469208155136:12345-0@lo:101: 00010000:00010000:2.0:1788586973.956433:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586973.956452:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab88a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88a4f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.956483:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab88a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88a4f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.956496:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab88a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88a4f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.956507:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5a00, rc 0) 00000100:00100000:2.0:1788586973.956564:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208155136:12345-0@lo:101: Request processed in 152us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.956571:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788586973.956890:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155136:0@lo:101: 00010000:00010000:0.0:1788586973.956909:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.956919:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586973.957002:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155264:0@lo:501: 00000100:00100000:0.0:1788586973.957035:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.959199:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.959277:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155264 00000100:00100000:2.0:1788586973.959357:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155264 00000100:00100000:0.0:1788586973.959925:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788586973.959943:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208155264:12345-0@lo:501: 00000100:00100000:0.0:1788586973.960459:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208155264:12345-0@lo:501: Request processed in 520us (3421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586973.960469:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788586973.960618:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155264:0@lo:501: 00000100:00100000:2.0:1788586973.960690:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155392:0@lo:503: 00000100:00100000:2.0:1788586973.960754:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586973.961173:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004180 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.961951:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155392 00000100:00100000:3.0:1788586973.961964:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155392 00000100:00100000:3.0:1788586973.962036:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788586973.962048:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208155392:12345-0@lo:503: 00000100:00100000:2.0:1788586973.962539:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155392:0@lo:503: 00000100:00100000:3.0:1788586973.962548:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208155392:12345-0@lo:503: Request processed in 499us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.962559:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788586973.963105:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8486:1875469208155520:0@lo:502: 00000100:00100000:2.0:1788586973.963158:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586973.963240:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac860043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586973.963277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155520 00000100:00100000:0.0:1788586973.963349:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155520 00000100:00100000:0.0:1788586973.963433:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788586973.963443:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:8486:x1875469208155520:12345-0@lo:502: 00000100:00100000:0.0:1788586973.963707:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:8486:x1875469208155520:12345-0@lo:502: Request processed in 264us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586973.963715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788586973.963745:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8486:1875469208155520:0@lo:502: 00000100:00100000:2.0:1788586973.963792:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8486:1875469208155648:0@lo:502: 00000100:00100000:2.0:1788586973.963841:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586973.963904:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac860043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.963925:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155648 00000100:00100000:3.0:1788586973.963929:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155648 00000100:00100000:3.0:1788586973.963955:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788586973.963963:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:8486:x1875469208155648:12345-0@lo:502: 00000100:00100000:3.0:1788586973.964095:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:8486:x1875469208155648:12345-0@lo:502: Request processed in 133us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.964103:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788586973.964107:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8486:1875469208155648:0@lo:502: 00000040:00080000:2.0:1788586973.964125:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788586973.964458:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788586973.964492:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788586973.964505:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.964533:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586973.964544:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788586973.964548:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788586973.964551:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788586973.964587:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.964597:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.964607:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586973.964623:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155776:0@lo:101: 00000100:00100000:0.0:1788586973.964657:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.964678:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.964684:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155776 00000100:00100000:2.0:1788586973.964690:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155776 00000100:00100000:2.0:1788586973.964724:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788586973.964731:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+13:5847:x1875469208155776:12345-0@lo:101: 00010000:00010000:2.0:1788586973.964741:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586973.964756:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4c00/0xc1a730b05ab88a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88a5d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.964783:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4c00/0xc1a730b05ab88a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88a5d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.964806:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4c00/0xc1a730b05ab88a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88a5d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.964838:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4c00, rc 0) 00000100:00100000:2.0:1788586973.964928:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208155776:12345-0@lo:101: Request processed in 196us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.964935:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788586973.964954:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155776:0@lo:101: 00010000:00010000:0.0:1788586973.964968:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.964982:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586973.965028:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155904:0@lo:501: 00000100:00100000:0.0:1788586973.965052:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.965085:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.965110:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208155904 00000100:00100000:3.0:1788586973.965116:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208155904 00000100:00100000:3.0:1788586973.965158:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788586973.965167:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208155904:12345-0@lo:501: 00000100:00100000:3.0:1788586973.965629:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208155904:12345-0@lo:501: Request processed in 461us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.965637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788586973.965693:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208155904:0@lo:501: 00000100:00100000:0.0:1788586973.965724:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156032:0@lo:503: 00000100:00100000:0.0:1788586973.965768:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.965796:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.965887:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156032 00000100:00100000:2.0:1788586973.965892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156032 00000100:00100000:2.0:1788586973.965961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788586973.965968:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208156032:12345-0@lo:503: 00000100:00100000:2.0:1788586973.966155:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208156032:12345-0@lo:503: Request processed in 187us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.966162:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788586973.966257:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156032:0@lo:503: 00000100:00100000:0.0:1788586973.967234:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8487:1875469208156160:0@lo:502: 00000100:00100000:0.0:1788586973.967408:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.967455:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.967571:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156160 00000100:00100000:3.0:1788586973.967580:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156160 00000100:00100000:3.0:1788586973.967626:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788586973.967637:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:8487:x1875469208156160:12345-0@lo:502: 00000100:00100000:3.0:1788586973.968164:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:8487:x1875469208156160:12345-0@lo:502: Request processed in 528us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.968173:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788586973.968299:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8487:1875469208156160:0@lo:502: 00000020:01000000:0.0:1788586973.968343:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788586973.968354:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586973.968357:0:8487:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788586973.968364:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788586973.968394:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8487:1875469208156288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586973.968434:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.968468:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.968478:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156288 00000100:00100000:2.0:1788586973.968486:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156288 00000100:00100000:2.0:1788586973.968532:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788586973.968540:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:8487:x1875469208156288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586973.968697:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:8487:x1875469208156288:12345-0@lo:502:llog_process_th.0 Request processed in 157us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.968705:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788586973.968718:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8487:1875469208156288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788586973.968743:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788586973.968748:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788586973.968750:0:8487:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788586973.968754:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788586973.968922:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788586973.968954:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788586973.968967:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.968986:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586973.968998:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788586973.969001:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bacaf3ef800 from 39 10000000:01000000:1.0:1788586973.969005:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788586973.969040:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.969050:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.969060:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586973.969082:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.969118:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.969196:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.969235:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156416 00000100:00100000:3.0:1788586973.969241:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156416 00000100:00100000:3.0:1788586973.969275:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788586973.969405:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:5847:x1875469208156416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586973.969420:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788586973.969437:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c5400/0xc1a730b05ab88a72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88a6b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.969474:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c5400/0xc1a730b05ab88a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88a6b expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.969487:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c5400/0xc1a730b05ab88a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88a6b expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.969504:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5400, rc 0) 00000100:00100000:3.0:1788586973.969605:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208156416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 323us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.969627:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788586973.969700:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586973.969715:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.969726:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586973.969795:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.969835:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.969903:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.970255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156544 00000100:00100000:2.0:1788586973.970263:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156544 00000100:00100000:2.0:1788586973.970497:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788586973.970514:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208156544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586973.970996:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208156544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 483us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.971013:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788586973.971212:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.971261:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.971438:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.971532:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.971706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156672 00000100:00100000:3.0:1788586973.971714:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156672 00000100:00100000:3.0:1788586973.971773:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788586973.971784:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208156672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.972260:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208156672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 476us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.972414:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788586973.972504:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208156672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586973.973150:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8488:1875469208156800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586973.973200:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586973.973263:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb4d85600 going to sleep for 11 seconds 00000100:00100000:0.0:1788586973.973409:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156800 00000100:00100000:0.0:1788586973.973420:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156800 00000100:00100000:0.0:1788586973.973463:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788586973.973472:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:8488:x1875469208156800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586973.973735:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:8488:x1875469208156800:12345-0@lo:502:llog_process_th.0 Request processed in 264us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586973.973754:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788586973.973935:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8488:1875469208156800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586973.973989:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8488:1875469208156928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586973.974027:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586973.974111:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb4d85600 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.974179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208156928 00000100:00100000:3.0:1788586973.974184:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208156928 00000100:00100000:3.0:1788586973.974246:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788586973.974255:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:8488:x1875469208156928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586973.974438:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:8488:x1875469208156928:12345-0@lo:502:llog_process_th.0 Request processed in 184us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.974446:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788586973.974511:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8488:1875469208156928:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788586973.974534:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788586973.974722:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788586973.974749:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788586973.974763:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.974776:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788586973.974787:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788586973.974791:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788586973.974794:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788586973.974838:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.974886:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.974896:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586973.974913:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.974949:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.975147:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.975212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157056 00000100:00100000:2.0:1788586973.975218:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157056 00000100:00100000:2.0:1788586973.975253:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788586973.975262:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:5847:x1875469208157056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586973.975274:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586973.975291:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab88a80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88a79 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.975321:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab88a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88a79 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.975335:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab88a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88a79 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586973.975346:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4600, rc 0) 00000100:00100000:2.0:1788586973.975426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208157056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.975432:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788586973.975532:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586973.975548:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.975558:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586973.975615:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.975644:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.975667:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.975712:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157184 00000100:00100000:2.0:1788586973.975716:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157184 00000100:00100000:2.0:1788586973.975758:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788586973.975765:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208157184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586973.976114:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208157184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.976121:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788586973.976234:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.976266:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.976309:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.976340:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.976380:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157312 00000100:00100000:2.0:1788586973.976384:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157312 00000100:00100000:2.0:1788586973.976444:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788586973.976452:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208157312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586973.976618:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208157312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.976625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788586973.976782:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.977062:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8489:1875469208157440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586973.977102:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.977330:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.977384:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157440 00000100:00100000:3.0:1788586973.977391:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157440 00000100:00100000:3.0:1788586973.977422:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788586973.977432:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:8489:x1875469208157440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586973.977626:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:8489:x1875469208157440:12345-0@lo:502:llog_process_th.0 Request processed in 194us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.977633:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788586973.977735:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8489:1875469208157440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788586973.977762:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586973.977773:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586973.977775:0:8489:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788586973.977781:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788586973.977804:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8489:1875469208157568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586973.977893:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586973.977907:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788586973.977958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157568 00000100:00100000:3.0:1788586973.977963:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157568 00000100:00100000:3.0:1788586973.977982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788586973.977990:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:8489:x1875469208157568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586973.978124:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:8489:x1875469208157568:12345-0@lo:502:llog_process_th.0 Request processed in 134us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586973.978131:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788586973.978224:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8489:1875469208157568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788586973.978242:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586973.978247:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586973.978249:0:8489:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788586973.978253:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788586973.978449:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788586973.978471:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788586973.978484:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.978497:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586973.978510:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788586973.978514:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bac83941800 from 39 10000000:01000000:3.0:1788586973.978517:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788586973.978546:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.978555:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.978566:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586973.978582:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.978616:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586973.978649:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586973.978697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157696 00000100:00100000:1.0:1788586973.978701:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157696 00000100:00100000:1.0:1788586973.978723:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788586973.978731:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208157696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586973.978741:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586973.978755:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf52b800/0xc1a730b05ab88a8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88a87 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.978780:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf52b800/0xc1a730b05ab88a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88a87 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.978792:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf52b800/0xc1a730b05ab88a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88a87 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.978800:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52b800, rc 0) 00000100:00100000:1.0:1788586973.978883:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208157696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586973.978890:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788586973.979040:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586973.979054:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.979071:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586973.979127:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.979154:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586973.979209:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586973.979311:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157824 00000100:00100000:0.0:1788586973.979316:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157824 00000100:00100000:1.0:1788586973.979361:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788586973.979369:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208157824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.979693:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208157824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586973.979706:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788586973.979957:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.979991:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.980035:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586973.980086:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788586973.980122:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208157952 00000100:00100000:1.0:1788586973.980126:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208157952 00000100:00100000:1.0:1788586973.980162:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788586973.980171:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208157952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.980387:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208157952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586973.980395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788586973.980501:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208157952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788586973.981183:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8490:1875469208158080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586973.981246:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.981332:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.981369:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158080 00000100:00100000:2.0:1788586973.981376:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158080 00000100:00100000:2.0:1788586973.981422:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788586973.981433:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8490:x1875469208158080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586973.981772:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8490:x1875469208158080:12345-0@lo:502:llog_process_th.0 Request processed in 342us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.981781:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788586973.982157:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8490:1875469208158080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586973.982223:0:8490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8490:1875469208158208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586973.982270:0:8490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.982348:0:8490:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004240 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.982380:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158208 00000100:00100000:2.0:1788586973.982385:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158208 00000100:00100000:2.0:1788586973.982450:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788586973.982459:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8490:x1875469208158208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586973.982688:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8490:x1875469208158208:12345-0@lo:502:llog_process_th.0 Request processed in 229us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.982696:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788586973.982698:0:8490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8490:1875469208158208:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788586973.982770:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788586973.984130:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788586973.984167:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788586973.984181:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.984195:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788586973.984208:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788586973.984212:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788586973.984215:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788586973.984264:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.984273:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.984304:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586973.984332:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.984404:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.984459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158336 00000100:00100000:3.0:1788586973.984460:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586973.984471:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158336 00000100:00100000:0.0:1788586973.984569:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788586973.984580:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208158336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586973.984595:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586973.984612:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a98a00/0xc1a730b05ab88a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88a95 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.984648:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a98a00/0xc1a730b05ab88a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88a95 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.984679:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a98a00/0xc1a730b05ab88a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88a95 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.984691:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98a00, rc 0) 00000100:00100000:0.0:1788586973.984756:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208158336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586973.984762:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788586973.984898:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788586973.984917:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788586973.984927:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586973.984988:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.985016:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586973.985215:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586973.985437:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158464 00000100:00100000:0.0:1788586973.985444:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158464 00000100:00100000:0.0:1788586973.985516:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788586973.985526:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208158464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586973.985907:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208158464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 381us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586973.985915:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788586973.985990:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.986024:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.986069:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586973.986263:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586973.986303:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158592 00000100:00100000:2.0:1788586973.986309:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158592 00000100:00100000:2.0:1788586973.986337:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788586973.986346:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208158592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586973.986589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208158592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586973.986598:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788586973.986665:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788586973.987205:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8491:1875469208158720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586973.987253:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586973.987290:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586973.987344:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158720 00000100:00100000:0.0:1788586973.987350:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158720 00000100:00100000:0.0:1788586973.987396:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788586973.987405:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8491:x1875469208158720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586973.987628:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8491:x1875469208158720:12345-0@lo:502:llog_process_th.0 Request processed in 223us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586973.987636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788586973.987720:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8491:1875469208158720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586973.987749:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788586973.987760:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586973.987763:0:8491:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788586973.987770:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788586973.987792:0:8491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8491:1875469208158848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788586973.987836:0:8491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586973.987879:0:8491:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586973.987946:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158848 00000100:00100000:0.0:1788586973.987950:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158848 00000100:00100000:0.0:1788586973.987975:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788586973.987982:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8491:x1875469208158848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586973.988125:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8491:x1875469208158848:12345-0@lo:502:llog_process_th.0 Request processed in 144us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586973.988132:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788586973.988209:0:8491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8491:1875469208158848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788586973.988229:0:8491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788586973.988234:0:8491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788586973.988235:0:8491:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788586973.988239:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788586973.988427:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788586973.988449:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788586973.988461:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.988475:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586973.988488:0:5847:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788586973.988491:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bac912719c0 from 1 10000000:01000000:0.0:1788586973.988495:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788586973.988526:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.988535:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.988546:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586973.988563:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788586973.988596:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.988630:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac893f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586973.988712:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208158976 00000100:00100000:1.0:1788586973.988719:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208158976 00000100:00100000:1.0:1788586973.988763:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788586973.988773:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208158976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586973.988783:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586973.988800:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf52a000/0xc1a730b05ab88aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88aa3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.988860:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf52a000/0xc1a730b05ab88aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88aa3 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.988874:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf52a000/0xc1a730b05ab88aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88aa3 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586973.988885:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52a000, rc 0) 00000100:00100000:1.0:1788586973.988920:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208158976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586973.988927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788586973.989085:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208158976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586973.989099:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88aaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.989120:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88aaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586973.989177:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208159104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586973.989205:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586973.989232:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac893f0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788586973.989272:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208159104 00000100:00100000:1.0:1788586973.989282:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208159104 00000100:00100000:1.0:1788586973.989312:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788586973.989318:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208159104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586973.989603:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208159104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (396us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788586973.989611:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788586973.989704:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208159104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788586973.989732:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788586973.989739:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88aaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586973.989749:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88aaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788586974.285063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586974.288084:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181915904 00000100:00100000:1.0:1788586974.288107:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181915904 00000100:00100000:1.0:1788586974.288221:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 166 00000100:00100000:1.0:1788586974.288235:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:5605:x1875469181915904:12345-192.168.204.28@tcp:101: 00010000:00010000:1.0:1788586974.288269:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788586974.288300:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf52a600/0xc1a730b05ab88ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2678 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586974.288338:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf52a600/0xc1a730b05ab88ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2678 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586974.288351:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf52a600/0xc1a730b05ab88ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2678 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586974.288362:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52a600, rc 0) 00000100:00100000:1.0:1788586974.288451:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5605:x1875469181915904:12345-192.168.204.28@tcp:101: Request processed in 219us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586974.288458:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 166 00000100:00100000:2.0:1788586974.294678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586974.296222:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916032 00000100:00100000:3.0:1788586974.296236:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916032 00000100:00100000:3.0:1788586974.296318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:3.0:1788586974.296329:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5605:x1875469181916032:12345-192.168.204.28@tcp:501: 00000100:00100000:3.0:1788586974.299331:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5605:x1875469181916032:12345-192.168.204.28@tcp:501: Request processed in 2993us (4666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586974.299346:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:2.0:1788586974.308295:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586974.308407:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916160 00000100:00100000:0.0:1788586974.308421:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916160 00000100:00100000:0.0:1788586974.308492:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:0.0:1788586974.308505:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5605:x1875469181916160:12345-192.168.204.28@tcp:503: 00000100:00100000:0.0:1788586974.309093:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5605:x1875469181916160:12345-192.168.204.28@tcp:503: Request processed in 587us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586974.309103:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:0.0:1788586974.339299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586974.339484:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916288 00000100:00100000:3.0:1788586974.339497:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916288 00000100:00100000:3.0:1788586974.339779:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:3.0:1788586974.339795:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:6077:x1875469181916288:12345-192.168.204.28@tcp:502: 00000100:00100000:3.0:1788586974.340229:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:6077:x1875469181916288:12345-192.168.204.28@tcp:502: Request processed in 436us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586974.340249:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:3.0:1788586974.348369:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586974.355128:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916416 00000100:00100000:2.0:1788586974.355149:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916416 00000100:00100000:2.0:1788586974.355570:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 170 00000100:00100000:2.0:1788586974.355585:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:6077:x1875469181916416:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788586974.364507:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:6077:x1875469181916416:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 8909us (16136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586974.364525:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 170 00000100:00100000:2.0:1788586974.388515:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586974.389374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916544 00000100:00100000:0.0:1788586974.389390:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916544 00000100:00100000:0.0:1788586974.389503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:0.0:1788586974.389517:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5605:x1875469181916544:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586974.389805:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586974.389839:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a99e00/0xc1a730b05ab88ab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c267f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586974.389895:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a99e00/0xc1a730b05ab88ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c267f expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586974.389910:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a99e00/0xc1a730b05ab88ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c267f expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586974.389921:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99e00, rc 0) 00000100:00100000:0.0:1788586974.390110:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181916544:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 595us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586974.390119:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:0.0:1788586974.394040:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586974.394311:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916672 00000100:00100000:2.0:1788586974.394325:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916672 00000100:00100000:2.0:1788586974.394440:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:2.0:1788586974.394452:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181916672:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586974.394964:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181916672:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 511us (938us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788586974.394974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 172 00010000:00010000:3.0:1788586974.915208:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788586975.864782:0:8528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde86c92a0 20000000:00000080:2.0:1788586975.864811:0:8528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bacbf522400 uarg=0000000000000000 20000000:01000000:2.0:1788586975.864888:0:8528:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788586975.864895:0:8528:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788586975.864899:0:8528:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788586975.866316:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788586975.866487:0:8528:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788586975.873132:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788586975.873198:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788586975.873258:0:8528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788586975.873285:0:8528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788586975.873304:0:8528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873324:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab88834 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873333:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873340:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873350:0:8528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873358:0:8528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873399:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873416:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 9 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.873431:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159232:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788586975.873762:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.873771:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 18 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.873805:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159360:0@lo:104: 00000100:00100000:1.0:1788586975.873878:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586975.873968:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208159360 00000100:00100000:0.0:1788586975.873976:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208159360 00000100:00100000:0.0:1788586975.874032:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788586975.874042:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8528:x1875469208159360:12345-0@lo:104: 00010000:00010000:0.0:1788586975.874056:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.874086:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.874100:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 18 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.874111:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfaded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159488:0@lo:104: 00010000:00010000:0.0:1788586975.874116:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788586975.874125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8528:x1875469208159360:12345-0@lo:104: Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586975.874133:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788586975.874146:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586975.874161:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788586975.874172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208159488 00010000:00010000:1.0:1788586975.874182:0:8528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab88834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586975.874184:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208159488 00010000:00010000:1.0:1788586975.874194:0:8528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab88834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 18 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.874204:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159616:0@lo:104: 00000100:00100000:0.0:1788586975.874208:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788586975.874216:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1b1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8528:x1875469208159488:12345-0@lo:104: 00010000:00010000:0.0:1788586975.874225:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.874236:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586975.874251:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacae76fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788586975.874276:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159360:0@lo:104: 00010000:00010000:0.0:1788586975.874276:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788586975.874287:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1b1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8528:x1875469208159488:12345-0@lo:104: Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586975.874293:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfaded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159488:0@lo:104: 00000100:00100000:0.0:1788586975.874298:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788586975.874333:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208159616 00000100:00100000:0.0:1788586975.874336:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208159616 00000100:00100000:0.0:1788586975.874349:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788586975.874354:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8528:x1875469208159616:12345-0@lo:104: 00010000:00010000:0.0:1788586975.874362:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.874393:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788586975.874399:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:8528:x1875469208159616:12345-0@lo:104: Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586975.874405:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788586975.876093:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788586975.876106:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876117:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788586975.876121:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876149:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586975.876157:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586975.876162:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788586975.876210:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876218:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586975.876241:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876249:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc2051200/0xc1a730b05ab8895a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88961 expref: -99 pid: 7649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876268:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788586975.876271:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876276:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac80030200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788586975.876279:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876285:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586975.876290:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586975.876302:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788586975.876315:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876321:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586975.876335:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876343:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac80030200/0xc1a730b05ab8888f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88896 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.876354:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788586975.876357:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.876885:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159616:0@lo:104: 00010000:00010000:0.0:1788586975.877021:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc21c7c00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788586975.877025:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.877033:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788586975.877040:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788586975.877045:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788586975.877070:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.877076:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788586975.877093:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.877100:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc21c7c00/0xc1a730b05ab8882d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.877118:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586975.877120:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788586975.877122:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586975.877151:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208159872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788586975.877221:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586975.877284:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788586975.877290:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208160000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788586975.877311:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586975.877347:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208159872 00000100:00100000:0.0:1788586975.877354:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208159872 00000100:00100000:1.0:1788586975.877603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160000 00000100:00100000:1.0:1788586975.877608:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160000 00010000:00010000:1.0:1788586975.877637:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab88834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 20 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.877675:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788586975.877692:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+20:3314:x1875469208160000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788586975.877706:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586975.877712:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab88834 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 20 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.877723:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab88834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 20 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.877741:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab88834 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab8882d expref: 20 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.877757:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788586975.877808:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208160000:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586975.877815:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788586975.878090:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 18 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586975.878562:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788586975.878573:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3314:x1875469208159872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788586975.878585:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788586975.878591:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 18 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.878601:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 18 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.878615:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2051800/0xc1a730b05ab88896 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab8888f expref: 18 pid: 5844 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586975.878641:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586975.878676:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3314:x1875469208159872:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586975.878682:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788586975.881829:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208159744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788586975.882527:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788586975.891223:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586975.892094:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208159744 00000100:00100000:3.0:1788586975.892109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208159744 00010000:00010000:3.0:1788586975.892173:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 17 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.895190:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586975.895216:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3313:x1875469208159744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788586975.895237:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586975.895249:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 17 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.895263:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 17 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.895283:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc21c6c00/0xc1a730b05ab88961 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab8895a expref: 17 pid: 5842 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.895303:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788586975.895526:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208160000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788586975.895538:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208159872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788586975.895632:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3313:x1875469208159744:12345-0@lo:103:ldlm_bl.0 Request processed in 428us (13105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586975.895657:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788586975.895751:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208159744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788586975.907085:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8528:1875469208159232:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788586975.907128:0:8528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586975.907461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586975.907638:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916800 00000100:00100000:1.0:1788586975.907647:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916800 00010000:00010000:1.0:1788586975.907690:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 10 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.907738:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:1.0:1788586975.907749:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2362:x1875469181916800:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788586975.907766:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788586975.907772:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 10 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907797:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 10 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907815:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab88a1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2647 expref: 10 pid: 5842 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907832:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907864:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907881:0:8474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907903:0:8474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907909:0:8474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.907916:0:8474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.908450:0:8474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52bc00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788586975.908456:0:8474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.908466:0:8474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.908492:0:8474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586975.908505:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788586975.908551:0:8528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586975.908563:0:8528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586975.908571:0:8528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf52bc00/0xc1a730b05ab88abf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586975.908646:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:2362:x1875469181916800:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 896us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586975.908656:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00010000:00010000:2.0:1788586975.939025:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586976.261219:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586976.261252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208160128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586976.261328:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586976.261401:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160128 00000100:00100000:2.0:1788586976.261410:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160128 00000100:00100000:2.0:1788586976.261472:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788586976.261494:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208160128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788586976.261533:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586976.261584:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208160128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586976.261591:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788586976.261613:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586976.261662:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadd880 x1875469208160128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586976.261682:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208160128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586976.273726:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208160256:0@lo:400:kworker.0 00000100:00100000:3.0:1788586976.273822:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586976.273909:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586976.273917:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208160640:0@lo:400:kworker.0 00000100:00100000:3.0:1788586976.273944:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586976.273990:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160640 00000100:00100000:3.0:1788586976.273998:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160640 00000100:00100000:3.0:1788586976.274057:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788586976.274067:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208160640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586976.274115:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208160640:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586976.274122:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788586976.274146:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788586976.274174:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadfb80 x1875469208160640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586976.274190:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208160640:0@lo:400:kworker.0 00000100:00100000:1.0:1788586976.274594:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160256 00000100:00100000:1.0:1788586976.274600:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160256 00000100:00100000:1.0:1788586976.274633:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788586976.274640:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208160256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788586976.274684:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208160256:12345-0@lo:400:kworker.0 Request processed in 45us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586976.274710:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788586976.274821:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208160384:0@lo:400:kworker.0 00000100:00100000:0.0:1788586976.274898:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586976.274922:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788586976.274929:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208160512:0@lo:400:kworker.0 00000100:00100000:0.0:1788586976.274952:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586976.275205:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160384 00000100:00100000:0.0:1788586976.275209:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160384 00000100:00100000:0.0:1788586976.275249:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160512 00000100:00100000:0.0:1788586976.275252:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160512 00000100:00100000:0.0:1788586976.275269:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788586976.275276:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208160384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586976.275313:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208160384:12345-0@lo:400:kworker.0 Request processed in 37us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586976.275319:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788586976.275330:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586976.275335:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208160512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586976.275367:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208160512:12345-0@lo:400:kworker.0 Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586976.275373:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788586976.275405:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208160512:0@lo:400:kworker.0 00000100:00100000:0.0:1788586976.275414:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfaded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208160384:0@lo:400:kworker.0 00000100:00080000:1.0:1788586976.275460:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788586976.275589:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208160256:0@lo:400:kworker.0 00000100:00100000:2.0:1788586976.391949:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586976.397645:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181916928 00000100:00100000:0.0:1788586976.397663:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181916928 00000100:00100000:0.0:1788586976.397747:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:0.0:1788586976.397758:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:5605:x1875469181916928:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586976.397786:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586976.397810:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2686 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586976.397857:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586976.397870:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586976.397881:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788586976.397977:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181916928:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 220us (6141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586976.397984:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:1.0:1788586976.402803:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586976.402897:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917056 00000100:00100000:2.0:1788586976.402909:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917056 00000100:00100000:2.0:1788586976.402985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 174 00000100:00100000:2.0:1788586976.402998:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181917056:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586976.403420:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181917056:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 423us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586976.403431:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 174 00000100:00100000:0.0:1788586976.415694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586976.415956:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917184 00000100:00100000:1.0:1788586976.415971:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917184 00000100:00100000:1.0:1788586976.416054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:1.0:1788586976.416066:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181917184:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586976.416643:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:5605:x1875469181917184:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 575us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586976.416653:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:2.0:1788586976.432156:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586976.433244:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917312 00000100:00100000:1.0:1788586976.433261:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917312 00000100:00100000:1.0:1788586976.433343:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:1.0:1788586976.433355:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:6135:x1875469181917312:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788586976.433724:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:6135:x1875469181917312:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 370us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586976.433734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:0.0:1788586976.443424:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788586976.446627:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917440 00000100:00100000:1.0:1788586976.446650:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917440 00000100:00100000:1.0:1788586976.446737:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:1.0:1788586976.446749:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:6135:x1875469181917440:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788586976.447300:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:6135:x1875469181917440:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 549us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586976.447310:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:2.0:1788586976.771954:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586976.771983:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208160768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586976.772082:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586976.772573:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160768 00000100:00100000:1.0:1788586976.772592:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160768 00000100:00100000:1.0:1788586976.772656:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788586976.772672:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208160768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586976.772719:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788586976.772791:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208160768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586976.779108:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788586976.779882:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadce00 x1875469208160768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586976.779911:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208160768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788586976.964333:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788586977.666969:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788586977.666990:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacbb896000 from 4 10000000:01000000:0.0:1788586977.666995:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788586977.667044:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.667056:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.667069:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.667098:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208160896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788586977.667176:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586977.667237:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab832ffa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.667462:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208160896 00000100:00100000:2.0:1788586977.667471:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208160896 00000100:00100000:0.0:1788586977.667655:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788586977.667668:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208160896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788586977.667683:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788586977.667700:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88acd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.667726:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.667738:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788586977.667760:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99800, rc 0) 00000100:00100000:0.0:1788586977.667819:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208160896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.667826:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788586977.667978:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208160896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788586977.667997:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788586977.668006:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788586977.668067:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586977.668096:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.668123:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac8517f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586977.668178:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161024 00000100:00100000:0.0:1788586977.668183:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161024 00000100:00100000:0.0:1788586977.668215:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788586977.668223:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208161024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788586977.668500:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208161024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.668521:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788586977.668896:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788586977.668932:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586977.668976:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.668997:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac8517f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.669078:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161152 00000100:00100000:2.0:1788586977.669082:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161152 00000100:00100000:2.0:1788586977.669110:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788586977.669118:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208161152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.669278:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208161152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.669291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788586977.669332:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.669551:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8605:1875469208161280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.669587:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.669607:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161280 00000100:00100000:2.0:1788586977.669611:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161280 00000100:00100000:2.0:1788586977.669632:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788586977.669638:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8605:x1875469208161280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.669772:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8605:x1875469208161280:12345-0@lo:502:llog_process_th.0 Request processed in 133us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.669779:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788586977.669806:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacae76f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.669818:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8605:1875469208161280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586977.669839:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586977.669872:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586977.669875:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788586977.669886:0:8605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacbb896000 00000020:00000080:2.0:1788586977.669889:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788586977.669963:0:8605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8605:1875469208161408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.669996:0:8605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.670013:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161408 00000100:00100000:2.0:1788586977.670015:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161408 00000100:00100000:2.0:1788586977.670035:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788586977.670041:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8605:x1875469208161408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.670140:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:8605:x1875469208161408:12345-0@lo:502:llog_process_th.0 Request processed in 98us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.670152:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788586977.670179:0:8605:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacae76f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.670190:0:8605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8605:1875469208161408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586977.670206:0:8605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586977.670210:0:8605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586977.670212:0:8605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788586977.670216:0:8605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788586977.670262:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788586977.670277:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788586977.670286:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.670297:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586977.670307:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586977.670310:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacaf3ef800 from 4 10000000:01000000:2.0:1788586977.670312:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586977.670332:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.670341:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.670350:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586977.670363:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.670388:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.670408:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacae76f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.670420:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161536 00000100:00100000:2.0:1788586977.670423:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161536 00000100:00100000:2.0:1788586977.670442:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788586977.670449:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208161536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586977.670456:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586977.670467:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88adb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.670488:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.670498:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.670507:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4a00, rc 0) 00000100:00100000:2.0:1788586977.670534:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208161536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.670539:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788586977.670565:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586977.670577:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.670587:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586977.670626:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.670651:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.670669:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacae76f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.670680:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161664 00000100:00100000:2.0:1788586977.670683:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161664 00000100:00100000:2.0:1788586977.670703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788586977.670710:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208161664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.670958:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208161664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.670965:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788586977.670997:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.671022:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.671052:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.671064:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac903470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.671075:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161792 00000100:00100000:2.0:1788586977.671078:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161792 00000100:00100000:2.0:1788586977.671099:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788586977.671105:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208161792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.671209:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208161792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.671215:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788586977.671250:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208161792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788586977.681768:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8606:1875469208161920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586977.681882:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.681922:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac8517f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.682818:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208161920 00000100:00100000:2.0:1788586977.682827:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208161920 00000100:00100000:2.0:1788586977.682907:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788586977.682918:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8606:x1875469208161920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.683156:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8606:x1875469208161920:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.683169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788586977.683988:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8606:1875469208161920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788586977.684029:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788586977.684038:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586977.684041:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788586977.684046:0:8606:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacaf3ef800 00000020:00000080:1.0:1788586977.684049:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788586977.684133:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8606:1875469208162048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788586977.684180:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586977.684208:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac8517f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788586977.685479:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162048 00000100:00100000:0.0:1788586977.685492:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162048 00000100:00100000:0.0:1788586977.685872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788586977.685883:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8606:x1875469208162048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788586977.686122:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:8606:x1875469208162048:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.686129:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788586977.686980:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfaddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8606:1875469208162048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788586977.687016:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788586977.687024:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788586977.687026:0:8606:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788586977.687030:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788586977.690796:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788586977.690832:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788586977.690866:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.690880:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788586977.690891:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788586977.690894:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac83941800 from 4 10000000:01000000:2.0:1788586977.690898:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788586977.690934:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.690943:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.690954:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586977.690981:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208162176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.691056:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.691100:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac903473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.691126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162176 00000100:00100000:2.0:1788586977.691133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162176 00000100:00100000:2.0:1788586977.691180:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788586977.691189:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208162176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586977.691204:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788586977.691225:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88ae9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.691250:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.691261:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.691269:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4e00, rc 0) 00000100:00100000:2.0:1788586977.691309:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208162176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.691316:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788586977.691366:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208162176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788586977.691382:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.691391:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788586977.691440:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208162304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.691466:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.691480:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac903473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.691492:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162304 00000100:00100000:2.0:1788586977.691495:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162304 00000100:00100000:2.0:1788586977.691514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788586977.691520:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208162304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.691764:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208162304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.691776:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788586977.691807:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208162304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.691832:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208162432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.691887:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.691898:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.691909:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162432 00000100:00100000:2.0:1788586977.691912:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162432 00000100:00100000:2.0:1788586977.691932:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788586977.691938:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208162432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.692072:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208162432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.692081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788586977.692116:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208162432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788586977.692296:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8609:1875469208162560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.692326:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.692344:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162560 00000100:00100000:2.0:1788586977.692348:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162560 00000100:00100000:2.0:1788586977.692369:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788586977.692375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:8609:x1875469208162560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.692493:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:8609:x1875469208162560:12345-0@lo:502:llog_process_th.0 Request processed in 118us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.692500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788586977.692526:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.692538:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8609:1875469208162560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586977.692562:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788586977.692572:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586977.692574:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788586977.692587:0:8609:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bac83941800 00000020:00000080:2.0:1788586977.692589:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788586977.692663:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8609:1875469208162688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.692692:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586977.692709:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162688 00000100:00100000:2.0:1788586977.692712:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162688 00000100:00100000:2.0:1788586977.692733:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788586977.692738:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:8609:x1875469208162688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788586977.692878:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:8609:x1875469208162688:12345-0@lo:502:llog_process_th.0 Request processed in 138us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586977.692885:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788586977.692912:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788586977.692924:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:8609:1875469208162688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788586977.692942:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788586977.692946:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788586977.692947:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788586977.692952:0:8609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788586977.692999:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788586977.693011:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788586977.693019:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788586977.693029:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788586977.812093:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586977.812142:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586977.812171:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586977.812197:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586977.812235:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917696 00000100:00100000:0.0:1788586977.812245:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917696 00000100:00100000:0.0:1788586977.812309:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788586977.812320:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181917696:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788586977.812415:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181917696:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.812423:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788586977.812453:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917824 00000100:00100000:0.0:1788586977.812456:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917824 00000100:00100000:0.0:1788586977.812507:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917952 00000100:00100000:0.0:1788586977.812511:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917952 00000100:00100000:0.0:1788586977.812530:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1788586977.812536:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181917824:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788586977.812565:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181917824:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 29us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.812572:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1788586977.812584:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:0.0:1788586977.812590:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469181917952:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788586977.812613:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469181917952:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586977.812619:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00080000:0.0:1788586977.812639:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586977.812643:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788586977.812646:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788586977.813040:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181917568 00000100:00100000:3.0:1788586977.813052:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181917568 00000100:00100000:3.0:1788586977.813090:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 193 00000100:00100000:3.0:1788586977.813099:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181917568:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788586977.813132:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181917568:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 35us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586977.813138:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 193 00010000:00010000:1.0:1788586977.989733:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586979.011153:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586980.036551:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586981.061057:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586981.379838:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208162944:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.379935:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586981.379989:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208163456:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.380016:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586981.380047:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788586981.380053:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208162816:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.380080:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586981.380102:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208163328:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.380124:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586981.380152:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208163072:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.380186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586981.380206:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788586981.380211:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208163200:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.380232:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586981.380268:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162944 00000100:00100000:0.0:1788586981.380276:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162944 00000100:00100000:0.0:1788586981.386813:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163328 00000100:00100000:0.0:1788586981.386828:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163328 00000100:00100000:0.0:1788586981.386869:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163072 00000100:00100000:0.0:1788586981.386873:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163072 00000100:00100000:0.0:1788586981.386894:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586981.386904:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208162944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.387005:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208162944:12345-0@lo:400:kworker.0 Request processed in 102us (7069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586981.387013:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788586981.387031:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788586981.387037:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208163328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.387067:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208163328:12345-0@lo:400:kworker.0 Request processed in 30us (6941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586981.387073:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788586981.387084:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788586981.387090:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208163072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.387121:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208163072:12345-0@lo:400:kworker.0 Request processed in 32us (6934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586981.387128:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788586981.387149:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163456 00000100:00100000:0.0:1788586981.387154:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163456 00000100:00100000:0.0:1788586981.387192:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163200 00000100:00100000:0.0:1788586981.387196:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163200 00000100:00100000:0.0:1788586981.387212:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586981.387217:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208163456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.387252:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208163456:12345-0@lo:400:kworker.0 Request processed in 34us (7235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586981.387257:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586981.387268:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788586981.387273:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208163200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.387556:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208163200:12345-0@lo:400:kworker.0 Request processed in 282us (7322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586981.387564:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788586981.387585:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208162816 00000100:00100000:0.0:1788586981.387590:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208162816 00000100:00100000:0.0:1788586981.387628:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788586981.387635:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208162816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.387666:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208162816:12345-0@lo:400:kworker.0 Request processed in 31us (7584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586981.387671:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:0.0:1788586981.387726:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788586981.387730:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788586981.387733:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586981.387746:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788586981.387763:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208163584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788586981.387796:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586981.387838:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163584 00000100:00100000:0.0:1788586981.387863:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163584 00000100:00100000:0.0:1788586981.387891:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788586981.387907:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208163584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788586981.387939:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788586981.387977:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208163584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586981.387983:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788586981.388025:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64f480 x1875469208163584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586981.388048:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208163584:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788586981.388081:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83050000 x1875469208163200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586981.388091:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208163200:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.388102:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208163072:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.388131:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208162816:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.388142:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208163328:0@lo:400:kworker.0 00000100:00100000:0.0:1788586981.388154:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208162944:0@lo:400:kworker.0 00010000:00080000:0.0:1788586981.388166:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacaf1bd500 x1875469208163456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788586997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586981.388176:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208163456:0@lo:400:kworker.0 00000100:00100000:2.0:1788586981.898721:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208163712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586981.898796:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586981.899402:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163712 00000100:00100000:2.0:1788586981.899412:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163712 00000100:00100000:2.0:1788586981.899481:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788586981.899492:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208163712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788586981.899530:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586981.899583:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208163712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586981.899590:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788586981.900631:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64c380 x1875469208163712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788586997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586981.900659:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208163712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788586982.083249:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788586982.947578:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586982.947631:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586982.947673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586982.947702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586982.947729:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918080 00000100:00100000:3.0:1788586982.947740:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918080 00000100:00100000:3.0:1788586982.947791:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:3.0:1788586982.947802:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2361:x1875469181918080:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788586982.947893:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2361:x1875469181918080:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586982.947900:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:3.0:1788586982.947934:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918336 00000100:00100000:3.0:1788586982.947938:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918336 00000100:00100000:3.0:1788586982.947972:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918464 00000100:00100000:3.0:1788586982.947975:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918464 00000100:00100000:3.0:1788586982.947991:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:3.0:1788586982.947998:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2361:x1875469181918336:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788586982.948040:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2361:x1875469181918336:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586982.948047:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:3.0:1788586982.948059:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1788586982.948065:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181918464:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788586982.948088:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181918464:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586982.948094:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00080000:3.0:1788586982.948232:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586982.948237:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788586982.951414:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918208 00000100:00100000:1.0:1788586982.951430:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918208 00000100:00100000:1.0:1788586982.951521:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:1.0:1788586982.951532:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181918208:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788586982.951621:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181918208:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 91us (4053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586982.951629:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00080000:2.0:1788586982.951812:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788586983.111406:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586983.145360:0:8829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788586984.131775:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788586985.157007:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788586986.190337:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586986.502594:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208163968:0@lo:400:kworker.0 00000100:00100000:0.0:1788586986.502676:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586986.502741:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208164480:0@lo:400:kworker.0 00000100:00100000:0.0:1788586986.502788:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586986.502819:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788586986.502826:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208163840:0@lo:400:kworker.0 00000100:00100000:0.0:1788586986.502873:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586986.502893:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208164352:0@lo:400:kworker.0 00000100:00100000:0.0:1788586986.502914:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586986.502945:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163968 00000100:00100000:0.0:1788586986.502953:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163968 00000100:00100000:0.0:1788586986.503001:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164352 00000100:00100000:0.0:1788586986.503005:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164352 00000100:00100000:0.0:1788586986.503038:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788586986.503048:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208163968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586986.503106:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208163968:12345-0@lo:400:kworker.0 Request processed in 60us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586986.503113:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788586986.503133:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586986.503140:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208164352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586986.503168:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208164352:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586986.503173:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788586986.503223:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208164352:0@lo:400:kworker.0 00000100:00100000:0.0:1788586986.503235:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208163968:0@lo:400:kworker.0 00000100:00100000:3.0:1788586986.503475:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788586986.503507:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586986.503535:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788586986.503541:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208164096:0@lo:400:kworker.0 00000100:00100000:3.0:1788586986.503561:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586986.503600:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164480 00000100:00100000:3.0:1788586986.503605:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164480 00000100:00100000:3.0:1788586986.503635:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164224 00000100:00100000:3.0:1788586986.503639:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164224 00000100:00100000:3.0:1788586986.503655:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586986.503663:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208164480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586986.503704:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208164480:12345-0@lo:400:kworker.0 Request processed in 42us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586986.503711:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788586986.503724:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788586986.503730:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208164224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586986.503773:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208164224:12345-0@lo:400:kworker.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586986.503779:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788586986.503823:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacaf1be680 x1875469208164224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586986.503835:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788586986.503873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164096 00000100:00100000:3.0:1788586986.503877:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164096 00000100:00100000:3.0:1788586986.503899:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788586986.503904:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208164096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586986.503935:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208164096:12345-0@lo:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586986.503941:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788586986.503963:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208164096:0@lo:400:kworker.0 00010000:00080000:3.0:1788586986.503984:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacaf1bc380 x1875469208164480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788586986.503993:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208164480:0@lo:400:kworker.0 00000100:00100000:2.0:1788586986.504132:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208164608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586986.504164:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586986.504198:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208163840 00000100:00100000:2.0:1788586986.504202:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208163840 00000100:00100000:2.0:1788586986.504226:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788586986.504233:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208163840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586986.504265:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208163840:12345-0@lo:400:kworker.0 Request processed in 32us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586986.504270:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:2.0:1788586986.504311:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788586986.504315:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788586986.504318:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586986.504328:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164608 00000100:00100000:2.0:1788586986.504350:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164608 00000100:00100000:2.0:1788586986.504379:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788586986.504385:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208164608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788586986.504410:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586986.504445:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208164608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586986.504451:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788586986.504481:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64d880 x1875469208164608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586986.504496:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208164608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788586986.506208:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208163840:0@lo:400:kworker.0 00000100:00100000:2.0:1788586987.012538:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788586987.012568:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208164736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586987.012656:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586987.021606:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164736 00000100:00100000:3.0:1788586987.021624:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164736 00000100:00100000:3.0:1788586987.021703:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788586987.021715:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208164736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788586987.021765:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788586987.021899:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208164736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (9242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586987.021928:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788586987.023394:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64d880 x1875469208164736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586987.023427:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208164736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788586987.203156:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586988.050438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586988.050884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586988.050924:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918720 00000100:00100000:0.0:1788586988.050945:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918720 00000100:00100000:0.0:1788586988.051018:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:0.0:1788586988.051029:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181918720:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788586988.051194:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181918720:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 166us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586988.051203:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00080000:0.0:1788586988.051230:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586988.051730:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918592 00000100:00100000:2.0:1788586988.051890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918592 00000100:00100000:2.0:1788586988.051992:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00100000:2.0:1788586988.052002:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2361:x1875469181918592:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788586988.052056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2361:x1875469181918592:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 56us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586988.052171:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00100000:3.0:1788586988.070731:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586988.070782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586988.070814:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918848 00000100:00100000:3.0:1788586988.070826:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918848 00000100:00100000:3.0:1788586988.070901:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181918976 00000100:00100000:3.0:1788586988.070904:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181918976 00000100:00100000:3.0:1788586988.070924:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788586988.070934:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2358:x1875469181918848:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:3.0:1788586988.070969:0:6708:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88a2c 00000100:00080000:3.0:1788586988.070980:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8bacbf55d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788586988.071027:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788586988.071431:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+2:2358:x1875469181918848:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 497us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586988.071440:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788586988.071458:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1788586988.071467:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2358:x1875469181918976:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:3.0:1788586988.071484:0:6708:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88a33 00000100:00080000:3.0:1788586988.071492:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8bac92c38000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788586988.071514:0:6708:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788586988.071719:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+2:2358:x1875469181918976:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 253us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586988.071727:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00010000:00010000:3.0:1788586988.071798:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788586988.071807:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788586988.071811:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788586988.072643:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586988.228100:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788586988.546395:0:9074:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing yml_node 00010000:00010000:3.0:1788586989.251496:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586990.275064:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586991.303981:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788586991.619723:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208165120:0@lo:400:kworker.0 00000100:00100000:1.0:1788586991.619803:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586991.619923:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208164864:0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.619968:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.619988:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208164992:0@lo:400:kworker.0 00000100:00100000:0.0:1788586991.620044:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.620085:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208165248:0@lo:400:kworker.0 00000100:00100000:0.0:1788586991.620118:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586991.620127:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164864 00000100:00100000:2.0:1788586991.620136:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164864 00000100:00100000:0.0:1788586991.620160:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208165120 00000100:00100000:0.0:1788586991.620166:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208165120 00000100:00100000:2.0:1788586991.620194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788586991.620206:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208164864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586991.620213:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208164992 00000100:00100000:0.0:1788586991.620217:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208164992 00000100:00100000:0.0:1788586991.620254:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788586991.620271:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208165120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.620280:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208164864:12345-0@lo:400:kworker.0 Request processed in 76us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.620290:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788586991.620622:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788586991.620633:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208165376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586991.621151:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586991.621211:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208164864:0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.624353:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788586991.624376:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208164992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.624497:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208164992:12345-0@lo:400:kworker.0 Request processed in 131us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.624505:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788586991.624575:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208164992:0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.624621:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208165376 00000100:00100000:2.0:1788586991.624627:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208165376 00000100:00100000:2.0:1788586991.625246:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788586991.625256:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208165376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788586991.625362:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586991.625416:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208165376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.625422:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788586991.625458:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64d880 x1875469208165376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586991.625505:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208165376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788586991.625550:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788586991.625555:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586991.625567:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208165248 00000100:00100000:2.0:1788586991.625571:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208165248 00000100:00100000:3.0:1788586991.626081:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788586991.626094:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208165248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788586991.626153:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208165248:12345-0@lo:400:kworker.0 Request processed in 63us (6034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586991.626160:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788586991.626402:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208165504:0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.626445:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586991.626496:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208165504 00000100:00100000:2.0:1788586991.626501:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208165504 00000100:00100000:2.0:1788586991.626537:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788586991.626545:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208165504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.626582:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208165504:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.626588:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788586991.626607:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586991.626632:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208165504:0@lo:400:kworker.0 00010000:00080000:2.0:1788586991.628717:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d80e00 x1875469208165248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586991.628739:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208165248:0@lo:400:kworker.0 00000100:00100000:0.0:1788586991.630479:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208165120:12345-0@lo:400:kworker.0 Request processed in 10206us (10665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586991.630505:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788586991.630587:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208165632:0@lo:400:kworker.0 00000100:00100000:0.0:1788586991.630657:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788586991.630731:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208165120:0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.632032:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208165632 00000100:00100000:2.0:1788586991.632044:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208165632 00000100:00100000:2.0:1788586991.632114:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788586991.632124:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208165632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586991.632213:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208165632:12345-0@lo:400:kworker.0 Request processed in 91us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586991.632256:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788586991.637632:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64d880 x1875469208165632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788586991.637653:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208165632:0@lo:400:kworker.0 00000100:00080000:3.0:1788586991.638091:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788586991.672203:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:1.0:1788586991.672214:0:6730:0:(genops.c:885:class_export_put()) final put ffff8bacbf55e000/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:2.0:1788586991.672365:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf55e000/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 for lustre-OST0000 00000020:00000080:2.0:1788586991.676503:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbf55d000 for lustre-OST0000 00000100:00100000:1.0:1788586992.134632:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788586992.134659:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208165760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788586992.134743:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788586992.134794:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208165760 00000100:00100000:1.0:1788586992.134803:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208165760 00000100:00100000:1.0:1788586992.134926:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788586992.134953:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208165760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788586992.134990:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788586992.135176:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208165760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 240us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788586992.135184:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788586992.135354:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadce00 x1875469208165760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788586992.135377:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208165760:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788586992.186372:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:3.0:1788586992.186395:0:7665:0:(genops.c:885:class_export_put()) final put ffff8bacbf55a000/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:1.0:1788586992.186539:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf55a000/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 for lustre-OST0001 00000020:00000080:1.0:1788586992.186590:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bac92c38000 for lustre-OST0001 00010000:00010000:3.0:1788586992.323833:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586993.169537:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586993.169655:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181919104 00000100:00100000:3.0:1788586993.169666:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181919104 00000100:00100000:3.0:1788586993.169772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00100000:3.0:1788586993.169787:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181919104:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788586993.170113:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181919104:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 329us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586993.170123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00100000:0.0:1788586993.176746:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788586993.177906:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181919232 00000100:00100000:2.0:1788586993.177922:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181919232 00000100:00100000:2.0:1788586993.178084:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1788586993.178097:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181919232:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788586993.178227:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181919232:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 118us (1483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586993.178235:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00080000:3.0:1788586993.179204:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788586993.348524:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788586993.420838:0:9268:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00010000:00010000:3.0:1788586994.372139:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586995.395357:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788586996.384676:0:9365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00010000:00010000:3.0:1788586996.419125:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788586996.744699:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208165888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586996.744810:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586996.744937:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208165888 00000100:00100000:2.0:1788586996.744948:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208165888 00000100:00100000:2.0:1788586996.745021:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788586996.745031:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208165888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788586996.745079:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586996.745137:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208165888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.745223:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788586996.745253:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788586996.745295:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64f480 x1875469208165888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586996.745345:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208165888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788586996.746833:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208166016:0@lo:400:kworker.0 00000100:00100000:2.0:1788586996.746942:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586996.747037:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166016 00000100:00100000:2.0:1788586996.747049:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166016 00000100:00100000:2.0:1788586996.747102:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788586996.747113:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208166016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586996.748176:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208166016:12345-0@lo:400:kworker.0 Request processed in 1055us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.748190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788586996.748218:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208166144:0@lo:400:kworker.0 00000100:00100000:3.0:1788586996.748264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788586996.748305:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788586996.748312:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208166272:0@lo:400:kworker.0 00000100:00100000:3.0:1788586996.748335:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586996.748573:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208166400:0@lo:400:kworker.0 00000100:00100000:2.0:1788586996.748602:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586996.748621:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788586996.748627:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208166528:0@lo:400:kworker.0 00000100:00100000:2.0:1788586996.748650:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586996.748698:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208166016:0@lo:400:kworker.0 00000100:00100000:0.0:1788586996.749138:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166144 00000100:00100000:0.0:1788586996.749147:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166144 00000100:00100000:0.0:1788586996.749197:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166272 00000100:00100000:0.0:1788586996.749200:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166272 00000100:00100000:0.0:1788586996.749229:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166400 00000100:00100000:0.0:1788586996.749232:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166400 00000100:00100000:0.0:1788586996.749251:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788586996.749260:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208166144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586996.749329:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208166144:12345-0@lo:400:kworker.0 Request processed in 70us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586996.749335:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788586996.749352:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586996.749358:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208166272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586996.749397:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208166272:12345-0@lo:400:kworker.0 Request processed in 27us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586996.749403:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788586996.749415:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788586996.749421:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208166400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788586996.749451:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208166400:12345-0@lo:400:kworker.0 Request processed in 31us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788586996.749457:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788586996.749483:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788586996.749510:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208166272:0@lo:400:kworker.0 00000100:00100000:0.0:1788586996.749522:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208166144:0@lo:400:kworker.0 00000100:00100000:0.0:1788586996.749547:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208166400:0@lo:400:kworker.0 00000100:00100000:2.0:1788586996.749751:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166528 00000100:00100000:2.0:1788586996.749756:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166528 00000100:00100000:2.0:1788586996.749797:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788586996.749803:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208166528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788586996.749880:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208166528:12345-0@lo:400:kworker.0 Request processed in 40us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586996.749887:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788586996.749903:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788586996.749936:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44f9500 x1875469208166528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586996.750024:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208166528:0@lo:400:kworker.0 00000100:00100000:2.0:1788586997.252290:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788586997.252328:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208166656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788586997.252444:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788586997.252547:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166656 00000100:00100000:2.0:1788586997.252558:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166656 00000100:00100000:2.0:1788586997.252632:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788586997.252644:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208166656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788586997.252693:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788586997.252751:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208166656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586997.252758:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788586997.252820:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64c000 x1875469208166656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788586997.252888:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208166656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788586997.443522:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788586998.283675:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788586998.283757:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788586998.283922:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181919360 00000100:00100000:3.0:1788586998.283937:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181919360 00000100:00100000:3.0:1788586998.284034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:3.0:1788586998.284050:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2362:x1875469181919360:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788586998.284181:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2362:x1875469181919360:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 135us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788586998.284189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:2.0:1788586998.284768:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181919488 00000100:00100000:2.0:1788586998.284789:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181919488 00000100:00100000:2.0:1788586998.284918:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:2.0:1788586998.284928:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181919488:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:0.0:1788586998.285068:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788586998.285151:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181919488:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 223us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788586998.285160:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00010000:00010000:3.0:1788586998.468611:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788586999.491597:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788586999.611342:0:9463:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00010000:00010000:3.0:1788587000.515405:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587001.544876:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587001.578045:0:9511:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 01:43:19 EDT 2026 00000100:00100000:2.0:1788587001.859146:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208166784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587001.859284:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587001.859389:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166784 00000100:00100000:2.0:1788587001.859400:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166784 00000100:00100000:2.0:1788587001.859472:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587001.859483:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208166784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587001.859533:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587001.859585:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208166784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587001.859595:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788587001.859624:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788587001.860018:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64c000 x1875469208166784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587001.860045:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208166784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587001.878205:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208166912:0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.878312:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587001.878367:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208167424:0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.878393:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587001.878422:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587001.878428:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208167040:0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.878473:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587001.878511:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208167296:0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.878537:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587001.878556:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587001.878561:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208167168:0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.878594:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587001.878625:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208166912 00000100:00100000:3.0:1788587001.878634:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208166912 00000100:00100000:3.0:1788587001.878692:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788587001.878718:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208166912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.878785:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208166912:12345-0@lo:400:kworker.0 Request processed in 70us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587001.878793:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788587001.878828:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167424 00000100:00100000:3.0:1788587001.878832:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167424 00000100:00100000:3.0:1788587001.878900:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587001.878907:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208167424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.878942:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208167424:12345-0@lo:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587001.878948:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587001.878966:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167040 00000100:00100000:3.0:1788587001.878970:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167040 00000100:00100000:3.0:1788587001.878999:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167296 00000100:00100000:3.0:1788587001.879002:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167296 00000100:00100000:3.0:1788587001.879021:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167168 00000100:00100000:3.0:1788587001.879024:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167168 00000100:00100000:3.0:1788587001.879041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788587001.879057:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208167040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.879099:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208167040:12345-0@lo:400:kworker.0 Request processed in 49us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587001.879106:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788587001.879120:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587001.879128:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208167296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.879178:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208167296:12345-0@lo:400:kworker.0 Request processed in 53us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587001.879185:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587001.879200:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587001.879216:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208167168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.879253:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208167168:12345-0@lo:400:kworker.0 Request processed in 48us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587001.879259:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587001.879322:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208167040:0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.879333:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208166912:0@lo:400:kworker.0 00010000:00080000:3.0:1788587001.879347:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44fbb80 x1875469208167424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587001.879358:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208167424:0@lo:400:kworker.0 00000100:00080000:3.0:1788587001.879383:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587001.879388:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587001.879408:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208167168:0@lo:400:kworker.0 00000100:00100000:3.0:1788587001.879418:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208167296:0@lo:400:kworker.0 00000100:00100000:0.0:1788587002.373297:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587002.373324:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208167552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587002.373405:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587002.373477:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167552 00000100:00100000:3.0:1788587002.373485:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167552 00000100:00100000:3.0:1788587002.373538:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587002.373548:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208167552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587002.373585:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587002.382994:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208167552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9437us (9579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587002.383019:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788587002.386614:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacaf1bc380 x1875469208167552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587002.386642:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208167552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587002.565326:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587003.403948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587003.404009:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587003.404039:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181919616 00000100:00100000:0.0:1788587003.404048:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181919616 00000100:00100000:0.0:1788587003.404109:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 203 00000100:00100000:0.0:1788587003.404120:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2359:x1875469181919616:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587003.404194:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2359:x1875469181919616:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587003.404202:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 203 00000100:00100000:1.0:1788587003.404400:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181919744 00000100:00100000:1.0:1788587003.404406:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181919744 00000100:00100000:1.0:1788587003.404459:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:1.0:1788587003.404466:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181919744:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587003.404505:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181919744:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 40us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587003.404511:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00080000:0.0:1788587003.404655:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587003.589987:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587004.611202:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587005.635197:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587006.660007:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587006.982121:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208167680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587006.982545:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.982606:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167680 00000100:00100000:3.0:1788587006.982614:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208168192:0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.982615:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167680 00000100:00100000:3.0:1788587006.982651:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.982671:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587006.982677:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208167808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.982688:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587006.982697:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208167680:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587006.982703:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.982723:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208168320:0@lo:400:kworker.0 00002000:00000024:2.0:1788587006.982733:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587006.982745:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.982777:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208168064:0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.982780:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208167680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.982787:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587006.982798:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.982815:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788587006.982821:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208167936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587006.982869:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587006.982893:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208168448:0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.982910:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168320 00000100:00100000:2.0:1788587006.982915:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168320 00000100:00100000:3.0:1788587006.982927:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587006.982941:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168064 00000100:00100000:2.0:1788587006.982944:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168064 00000100:00100000:2.0:1788587006.982958:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167936 00000100:00100000:2.0:1788587006.982961:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167936 00000100:00100000:2.0:1788587006.982994:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587006.983001:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208168320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.983036:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208168320:12345-0@lo:400:kworker.0 Request processed in 36us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.983043:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587006.983055:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587006.983060:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208168064:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788587006.983071:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587006.983077:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587006.983421:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788587006.983431:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208167936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587006.984814:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168192 00000100:00100000:3.0:1788587006.984836:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168192 00000100:00100000:3.0:1788587006.984919:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168448 00000100:00100000:3.0:1788587006.984922:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168448 00000100:00100000:3.0:1788587006.984984:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587006.984993:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208168192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587006.985491:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208168192:12345-0@lo:400:kworker.0 Request processed in 497us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.985500:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587006.985521:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788587006.985530:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208168448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.991487:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208168064:12345-0@lo:400:kworker.0 Request processed in 8414us (8674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.991508:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788587006.992766:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208167936:12345-0@lo:400:kworker.0 Request processed in 9327us (9885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587006.992782:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587006.994572:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208167936:0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.994800:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208167808 00000100:00100000:2.0:1788587006.994811:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208167808 00000100:00100000:2.0:1788587006.994896:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788587006.994907:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208167808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587006.995011:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208167808:12345-0@lo:400:kworker.0 Request processed in 107us (12306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587006.995018:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788587006.996245:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208168448:12345-0@lo:400:kworker.0 Request processed in 10706us (13304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587006.996259:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788587006.996304:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587006.996360:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208167808:0@lo:400:kworker.0 00000100:00100000:3.0:1788587006.996705:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208168320:0@lo:400:kworker.0 00010000:00080000:3.0:1788587006.996727:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64d880 x1875469208168192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587006.996737:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208168192:0@lo:400:kworker.0 00010000:00080000:3.0:1788587006.996748:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacae64c000 x1875469208167680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587006.996765:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208167680:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788587006.997221:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d83800 x1875469208168448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587006.997233:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208168448:0@lo:400:kworker.0 00000100:00100000:0.0:1788587006.997246:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208168064:0@lo:400:kworker.0 00000100:00100000:1.0:1788587007.493258:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208168576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587007.494511:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587007.495169:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168576 00000100:00100000:2.0:1788587007.495191:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168576 00000100:00100000:2.0:1788587007.495254:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587007.495267:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208168576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587007.496049:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587007.496174:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208168576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 906us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587007.496195:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788587007.496278:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadce00 x1875469208168576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587007.499450:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208168576:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587007.689413:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587008.532070:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587008.532175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587008.532257:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920000 00000100:00100000:2.0:1788587008.532267:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920000 00000100:00100000:2.0:1788587008.532336:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:2.0:1788587008.532346:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181920000:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587008.532425:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181920000:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587008.532434:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00080000:3.0:1788587008.532570:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587008.533931:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181919872 00000100:00100000:1.0:1788587008.533944:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181919872 00000100:00100000:1.0:1788587008.534036:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 205 00000100:00100000:1.0:1788587008.534046:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181919872:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587008.534114:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181919872:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 70us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587008.534121:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 205 00010000:00010000:3.0:1788587008.707051:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587009.731433:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587010.761532:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587011.779432:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587012.101714:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208168704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587012.101791:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.101897:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168704 00000100:00100000:3.0:1788587012.101904:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168704 00000100:00100000:3.0:1788587012.101960:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587012.101971:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208168704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587012.102009:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587012.102065:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208168704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.102072:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788587012.102104:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788587012.102230:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadd180 x1875469208168704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587012.102252:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208168704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587012.103036:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208169088:0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103103:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.103136:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587012.103143:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208168960:0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103172:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.103208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169088 00000100:00100000:3.0:1788587012.103214:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169088 00000100:00100000:3.0:1788587012.103264:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168960 00000100:00100000:3.0:1788587012.103280:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168960 00000100:00100000:3.0:1788587012.103311:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788587012.103321:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208169088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103375:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208169088:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.103382:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788587012.103399:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788587012.103405:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208168960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103432:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208168960:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.103449:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788587012.103477:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208168832:0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103509:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.103533:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208169344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103555:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.103576:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788587012.103582:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208169216:0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103604:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.103629:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169344 00000100:00100000:3.0:1788587012.103635:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169344 00000100:00100000:3.0:1788587012.103663:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587012.103669:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208169344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103704:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208169344:12345-0@lo:400:kworker.0 Request processed in 35us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.103710:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788587012.103728:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587012.103732:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587012.103753:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacc1ab0a80 x1875469208169344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587012.103766:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208169344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103787:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169216 00000100:00100000:3.0:1788587012.103790:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169216 00000100:00100000:3.0:1788587012.103816:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788587012.103821:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208169216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587012.103881:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208169216:12345-0@lo:400:kworker.0 Request processed in 59us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.103894:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788587012.103910:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587012.103928:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208169216:0@lo:400:kworker.0 00000100:00100000:1.0:1788587012.104276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208168832 00000100:00100000:1.0:1788587012.104282:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208168832 00000100:00100000:1.0:1788587012.104318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788587012.104326:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208168832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587012.104377:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208168832:12345-0@lo:400:kworker.0 Request processed in 53us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587012.104384:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788587012.104430:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208168960:0@lo:400:kworker.0 00000100:00100000:1.0:1788587012.104442:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208169088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587012.104473:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208168832:0@lo:400:kworker.0 00000100:00100000:2.0:1788587012.611093:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208169472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587012.611188:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587012.611805:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169472 00000100:00100000:3.0:1788587012.611816:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169472 00000100:00100000:3.0:1788587012.611895:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587012.611905:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208169472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587012.613063:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587012.613583:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208169472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1674us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587012.613594:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788587012.614563:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4d83800 x1875469208169472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587012.614590:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208169472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788587012.806052:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587013.643645:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587013.643698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587013.643734:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920256 00000100:00100000:3.0:1788587013.643745:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920256 00000100:00100000:3.0:1788587013.643807:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:3.0:1788587013.643830:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181920256:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587013.643930:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181920256:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587013.643938:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00080000:3.0:1788587013.643963:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587013.644154:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920128 00000100:00100000:1.0:1788587013.644159:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920128 00000100:00100000:1.0:1788587013.644199:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 207 00000100:00100000:1.0:1788587013.644208:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181920128:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587013.644246:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181920128:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 40us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587013.644252:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 207 00010000:00010000:0.0:1788587013.828045:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587014.852099:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587015.886361:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587016.901373:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587017.220638:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208169600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587017.220709:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587017.220752:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169600 00000100:00100000:1.0:1788587017.220773:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169600 00000100:00080000:3.0:1788587017.220822:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587017.220866:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587017.220879:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208169600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587017.220931:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587017.220987:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208169600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587017.221004:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788587017.221048:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadfb80 x1875469208169600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587017.221068:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208169600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587017.221346:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208169856:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.221380:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587017.221415:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788587017.221421:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208169728:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.221449:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587017.221472:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208170240:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.221496:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587017.221720:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169856 00000100:00100000:2.0:1788587017.221727:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169856 00000100:00100000:2.0:1788587017.221758:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587017.221776:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208169856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.221820:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208169856:12345-0@lo:400:kworker.0 Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.221827:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788587017.221891:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169728 00000100:00100000:2.0:1788587017.221895:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169728 00000100:00100000:2.0:1788587017.221917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788587017.221923:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208169728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.221951:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208169728:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.221957:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788587017.222007:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208169728:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.222020:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208169856:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.222042:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208170112:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.222065:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587017.222084:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587017.222090:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208169984:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.222110:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587017.222232:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208170240 00000100:00100000:3.0:1788587017.222237:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208170240 00000100:00100000:3.0:1788587017.222277:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587017.222284:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208170240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587017.222321:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208170240:12345-0@lo:400:kworker.0 Request processed in 37us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587017.222327:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587017.222345:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208170112 00000100:00100000:3.0:1788587017.222349:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208170112 00000100:00100000:3.0:1788587017.222368:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208169984 00000100:00100000:3.0:1788587017.222371:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208169984 00000100:00100000:3.0:1788587017.222384:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788587017.222390:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208170112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587017.222435:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208170112:12345-0@lo:400:kworker.0 Request processed in 45us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587017.222440:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788587017.222451:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788587017.222457:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208169984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587017.222480:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208169984:12345-0@lo:400:kworker.0 Request processed in 24us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587017.222492:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788587017.222829:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587017.222834:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788587017.222899:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5946d80 x1875469208170240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587017.222913:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208170240:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.222942:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208169984:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.222952:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208170112:0@lo:400:kworker.0 00000100:00100000:2.0:1788587017.733242:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587017.733268:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208170368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587017.733362:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587017.733457:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208170368 00000100:00100000:2.0:1788587017.733465:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208170368 00000100:00100000:2.0:1788587017.733527:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587017.733538:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208170368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587017.733571:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587017.733621:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208170368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587017.733628:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788587017.733675:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5946d80 x1875469208170368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587017.733695:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208170368:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587017.923991:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587018.467248:0:10141:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 01:43:36 (1788587016) === 00000100:00100000:3.0:1788587018.766174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587018.766230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587018.766343:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920384 00000100:00100000:1.0:1788587018.766354:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920384 00000100:00100000:1.0:1788587018.766420:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:1.0:1788587018.766432:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181920384:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587018.766512:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469181920384:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 83us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587018.766520:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:0.0:1788587018.767364:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920512 00000100:00100000:0.0:1788587018.767371:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920512 00000100:00100000:0.0:1788587018.767434:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:0.0:1788587018.767444:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181920512:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587018.767490:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181920512:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 48us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587018.767497:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00080000:2.0:1788587018.767657:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587018.936604:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587018.936712:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920640 00000100:00100000:2.0:1788587018.936736:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920640 00000100:00100000:2.0:1788587018.936799:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 210 00000100:00100000:2.0:1788587018.936810:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:8135:x1875469181920640:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587018.936827:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587018.936888:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4800/0xc1a730b05ab88af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c268d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587018.936920:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4800/0xc1a730b05ab88af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c268d expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587018.936933:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4800/0xc1a730b05ab88af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c268d expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587018.936943:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4800, rc 0) 00000100:00100000:2.0:1788587018.937335:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8135:x1875469181920640:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 525us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587018.937355:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 210 00010000:00010000:1.0:1788587018.947559:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587018.955069:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587018.955268:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920768 00000100:00100000:2.0:1788587018.955281:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920768 00000100:00100000:2.0:1788587018.955342:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:2.0:1788587018.955355:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8135:x1875469181920768:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788587018.955679:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8135:x1875469181920768:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 326us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587018.955688:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:3.0:1788587018.965038:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587018.965224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181920896 00000100:00100000:2.0:1788587018.965235:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181920896 00000100:00100000:2.0:1788587018.965299:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:2.0:1788587018.965311:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8135:x1875469181920896:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587018.965575:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8135:x1875469181920896:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 265us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587018.965583:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:3.0:1788587018.971374:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587018.971522:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921024 00000100:00100000:1.0:1788587018.971545:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921024 00000100:00100000:1.0:1788587018.971604:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:1.0:1788587018.971613:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8139:x1875469181921024:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587018.971942:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8139:x1875469181921024:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 328us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587018.971950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:3.0:1788587018.991979:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587018.992199:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921152 00000100:00100000:1.0:1788587018.992211:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921152 00000100:00100000:1.0:1788587018.992276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 214 00000100:00100000:1.0:1788587018.992288:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8139:x1875469181921152:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587018.992657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8139:x1875469181921152:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 370us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587018.992666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 214 00000100:00100000:3.0:1788587019.008233:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587019.008507:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921280 00000100:00100000:2.0:1788587019.008520:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921280 00000100:00100000:2.0:1788587019.008601:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:2.0:1788587019.008612:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:8135:x1875469181921280:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587019.008630:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587019.008649:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5000/0xc1a730b05ab88afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c26b7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.008679:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5000/0xc1a730b05ab88afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26b7 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.008713:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5000/0xc1a730b05ab88afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26b7 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.008737:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5000, rc 0) 00000100:00100000:2.0:1788587019.008795:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:8135:x1875469181921280:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 185us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587019.008803:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:2.0:1788587019.016427:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587019.019434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921408 00000100:00100000:3.0:1788587019.019450:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921408 00000100:00100000:3.0:1788587019.019607:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:3.0:1788587019.019619:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:8135:x1875469181921408:12345-192.168.204.28@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788587019.019649:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788587019.019673:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788587019.019677:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788587019.019680:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788587019.019682:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788587019.022345:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:8135:x1875469181921408:12345-192.168.204.28@tcp:256:mount.lustre.0 Request processed in 2716us (5917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.022360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:1.0:1788587019.028975:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587019.029231:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921536 00000100:00100000:2.0:1788587019.029244:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921536 00000100:00100000:2.0:1788587019.029305:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:2.0:1788587019.029316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:8135:x1875469181921536:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587019.029338:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587019.029362:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c26be expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.029400:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.029414:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587019.029425:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5800, rc 0) 00000100:00100000:2.0:1788587019.029490:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8135:x1875469181921536:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 176us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587019.029497:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:2.0:1788587019.034444:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587019.034559:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921664 00000100:00100000:1.0:1788587019.034571:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921664 00000100:00100000:1.0:1788587019.034629:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:1.0:1788587019.034639:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8135:x1875469181921664:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788587019.035415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8135:x1875469181921664:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 769us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.035432:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:3.0:1788587019.041241:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587019.041372:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921792 00000100:00100000:1.0:1788587019.041384:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921792 00000100:00100000:1.0:1788587019.041512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:1.0:1788587019.041525:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8135:x1875469181921792:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587019.041875:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8135:x1875469181921792:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 321us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.041883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:3.0:1788587019.046619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587019.046978:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181921920 00000100:00100000:1.0:1788587019.046989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181921920 00000100:00100000:1.0:1788587019.047059:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:1.0:1788587019.047070:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8143:x1875469181921920:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587019.047357:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8143:x1875469181921920:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 288us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.047366:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:3.0:1788587019.051630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587019.052026:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922048 00000100:00100000:1.0:1788587019.052038:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922048 00000100:00100000:1.0:1788587019.052101:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:1.0:1788587019.052112:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8143:x1875469181922048:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587019.052395:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:8143:x1875469181922048:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 284us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.052404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:3.0:1788587019.056494:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587019.056741:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922176 00000100:00100000:2.0:1788587019.056754:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922176 00000100:00100000:2.0:1788587019.056808:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1788587019.056817:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2358:x1875469181922176:12345-192.168.204.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587019.056886:0:7662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ab703820-03cd-48f7-bca8-7e3164455d6c@192.168.204.28@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:2.0:1788587019.056932:0:7662:0:(genops.c:1385:class_connect()) connect: client ab703820-03cd-48f7-bca8-7e3164455d6c, cookie 0xc1a730b05ab88b0c 00000004:00100000:2.0:1788587019.056977:0:7662:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587019.057291:0:7662:0:(import.c:65:import_set_state_nolock()) ffff8bab81222000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587019.057379:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2358:x1875469181922176:12345-192.168.204.28@tcp:38:mount.lustre.0 Request processed in 561us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587019.057387:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1788587019.067826:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587019.067975:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922304 00000100:00100000:3.0:1788587019.067987:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922304 00000100:00100000:3.0:1788587019.068076:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:3.0:1788587019.068088:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+6:0:x1875469181922304:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788587019.068139:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788587019.068255:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+6:0:x1875469181922304:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 170us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587019.068285:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00080000:2.0:1788587019.069021:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587019.070720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587019.072525:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922432 00000100:00100000:2.0:1788587019.072541:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922432 00000100:00100000:2.0:1788587019.072619:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:2.0:1788587019.072630:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:8135:x1875469181922432:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788587019.072665:0:7662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788587019.072758:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:8135:x1875469181922432:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 129us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587019.072765:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788587019.081890:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587019.082011:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922560 00000100:00100000:3.0:1788587019.082025:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922560 00000100:00100000:3.0:1788587019.082111:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1788587019.082122:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+6:8135:x1875469181922560:12345-192.168.204.28@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788587019.082234:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+6:8135:x1875469181922560:12345-192.168.204.28@tcp:40:mount.lustre.0 Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587019.082242:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1788587019.088534:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587019.088654:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587019.090006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587019.090244:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922944 00000100:00100000:3.0:1788587019.090255:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922944 00000100:00100000:3.0:1788587019.090324:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1788587019.090334:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+6:8135:x1875469181922944:12345-192.168.204.28@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788587019.090416:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788587019.090506:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+6:8135:x1875469181922944:12345-192.168.204.28@tcp:33:mount.lustre.0 Request processed in 173us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587019.090513:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:0.0:1788587019.092566:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922688 00000100:00100000:0.0:1788587019.092582:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922688 00000100:00100000:0.0:1788587019.092693:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181922816 00000100:00100000:0.0:1788587019.092697:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181922816 00000100:00100000:1.0:1788587019.096379:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788587019.096418:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875469181922688:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788587019.096462:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ab703820-03cd-48f7-bca8-7e3164455d6c@192.168.204.28@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:1.0:1788587019.096500:0:6707:0:(genops.c:1385:class_connect()) connect: client ab703820-03cd-48f7-bca8-7e3164455d6c, cookie 0xc1a730b05ab88b13 00002000:00100000:1.0:1788587019.096514:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ab703820-03cd-48f7-bca8-7e3164455d6c/ffff8bacbbc30000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788587019.096541:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788587019.096803:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587019.096857:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc33000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587019.097362:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2358:x1875469181922688:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 943us (8837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.097372:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788587019.097404:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1788587019.097411:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875469181922816:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788587019.097431:0:6707:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ab703820-03cd-48f7-bca8-7e3164455d6c@192.168.204.28@tcp t0 exp 0000000000000000 cur 341 last 0 00000020:00000080:1.0:1788587019.097449:0:6707:0:(genops.c:1385:class_connect()) connect: client ab703820-03cd-48f7-bca8-7e3164455d6c, cookie 0xc1a730b05ab88b1a 00002000:00100000:1.0:1788587019.097456:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ab703820-03cd-48f7-bca8-7e3164455d6c/ffff8bacbbc36800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788587019.097473:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788587019.097619:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788587019.097638:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc33800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587019.097663:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2358:x1875469181922816:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 251us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587019.097670:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00010000:00010000:0.0:1788587019.971544:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587020.995808:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587022.019930:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587022.339238:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208170496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587022.339317:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.339375:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208171008:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.339401:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.339440:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788587022.339447:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208170624:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.339484:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.339508:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208171136:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.339537:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.339568:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208170752:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.339610:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.339630:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208171264:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.339668:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.339690:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587022.339696:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208170880:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.339722:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.339761:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208170496 00000100:00100000:2.0:1788587022.339770:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208170496 00000100:00100000:2.0:1788587022.339832:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587022.339865:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208170496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587022.339916:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587022.339969:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208170496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.339977:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788587022.340002:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171008 00000100:00100000:2.0:1788587022.340007:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171008 00000100:00100000:2.0:1788587022.340031:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171264 00000100:00100000:2.0:1788587022.340034:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171264 00000100:00100000:2.0:1788587022.340052:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587022.340059:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208171008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340094:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208171008:12345-0@lo:400:kworker.0 Request processed in 35us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.340109:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587022.340124:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587022.340132:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208171264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340169:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208171264:12345-0@lo:400:kworker.0 Request processed in 37us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.340174:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788587022.340193:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208170624 00000100:00100000:2.0:1788587022.340197:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208170624 00000100:00100000:2.0:1788587022.340224:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788587022.340231:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208170624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340262:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208170624:12345-0@lo:400:kworker.0 Request processed in 33us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.340268:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788587022.340294:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171136 00000100:00100000:2.0:1788587022.340298:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171136 00000100:00100000:2.0:1788587022.340323:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208170752 00000100:00100000:2.0:1788587022.340326:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208170752 00000100:00100000:2.0:1788587022.340339:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208170880 00000100:00100000:2.0:1788587022.340341:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208170880 00000100:00100000:2.0:1788587022.340356:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587022.340361:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208171136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340391:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208171136:12345-0@lo:400:kworker.0 Request processed in 30us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.340398:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587022.340410:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587022.340416:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208170752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340459:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208170752:12345-0@lo:400:kworker.0 Request processed in 43us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.340466:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587022.340479:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788587022.340485:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340513:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208170880:12345-0@lo:400:kworker.0 Request processed in 29us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.340518:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788587022.340546:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587022.340551:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587022.340553:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587022.340588:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208170880:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340600:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208170752:0@lo:400:kworker.0 00010000:00080000:2.0:1788587022.340613:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac8a7f3100 x1875469208171264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587022.340624:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208171264:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340657:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5946d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208170624:0@lo:400:kworker.0 00000100:00100000:2.0:1788587022.340668:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208171136:0@lo:400:kworker.0 00010000:00080000:2.0:1788587022.340678:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbf98df80 x1875469208170496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587022.340692:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208170496:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788587022.340700:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac8a7f2d80 x1875469208171008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587022.340719:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208171008:0@lo:400:kworker.0 00000001:00100000:3.0:1788587022.402834:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab703820-03cd-48f7-bca8-7e3164455d6c 00000100:00100000:2.0:1788587022.854105:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208171392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587022.854189:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587022.854286:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171392 00000100:00100000:2.0:1788587022.854296:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171392 00000100:00100000:2.0:1788587022.854355:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587022.854367:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208171392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587022.854411:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587022.854473:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208171392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587022.854481:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788587022.854540:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac8a7f2d80 x1875469208171392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587038 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587022.854564:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208171392:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788587022.984090:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab703820-03cd-48f7-bca8-7e3164455d6c 00000001:00100000:3.0:1788587023.006117:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab703820-03cd-48f7-bca8-7e3164455d6c 00010000:00010000:1.0:1788587023.044523:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587024.067261:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587024.404136:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587024.404200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587024.404260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587024.404277:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923200 00000100:00100000:2.0:1788587024.404293:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587024.404310:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923200 00000100:00100000:2.0:1788587024.404330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587024.404397:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923072 00000100:00100000:1.0:1788587024.404401:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923072 00000100:00100000:1.0:1788587024.413992:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:1.0:1788587024.414020:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181923072:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587024.414124:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181923072:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 118us (9864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587024.414132:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:3.0:1788587024.415137:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923456 00000100:00100000:3.0:1788587024.415154:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923456 00000100:00100000:3.0:1788587024.415213:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923584 00000100:00100000:3.0:1788587024.415217:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923584 00000100:00100000:3.0:1788587024.415238:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:3.0:1788587024.415265:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181923456:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587024.415326:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181923456:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 64us (11126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587024.415346:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:3.0:1788587024.415372:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1788587024.415380:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181923584:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587024.415407:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181923584:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (11078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587024.415413:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00080000:3.0:1788587024.415642:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587024.415646:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587024.415650:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587024.423150:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923328 00000100:00100000:2.0:1788587024.423169:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923328 00000100:00080000:3.0:1788587024.423650:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587024.427188:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:0.0:1788587024.427222:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181923200:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587024.427357:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181923200:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 153us (23234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587024.427366:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:0.0:1788587024.427394:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:0.0:1788587024.427402:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181923328:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587024.427430:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181923328:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (23137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587024.427437:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00010000:00010000:0.0:1788587025.098331:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587025.933951:0:10340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788587026.120036:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587027.148551:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587027.459089:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587027.459110:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587027.459180:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587027.459286:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171520 00000100:00100000:2.0:1788587027.459303:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171520 00000100:00100000:2.0:1788587027.459362:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587027.459371:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208171520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587027.459404:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587027.459451:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208171520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587027.459458:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788587027.459480:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788587027.459516:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac8a7f2680 x1875469208171520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587027.459537:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587027.459809:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208171776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.459892:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587027.459920:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587027.459926:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208171904:0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.459948:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587027.459990:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171776 00000100:00100000:0.0:1788587027.459993:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171776 00000100:00100000:0.0:1788587027.460023:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171904 00000100:00100000:0.0:1788587027.460026:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171904 00000100:00100000:0.0:1788587027.460050:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587027.460057:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208171776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.460092:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208171776:12345-0@lo:400:kworker.0 Request processed in 35us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587027.460104:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788587027.460117:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587027.460123:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208171904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.460148:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208171904:12345-0@lo:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587027.460153:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788587027.460174:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587027.460190:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208171904:0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.460198:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208171776:0@lo:400:kworker.0 00000100:00100000:2.0:1788587027.460301:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208171648:0@lo:400:kworker.0 00000100:00100000:2.0:1788587027.460331:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587027.460364:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208172160:0@lo:400:kworker.0 00000100:00100000:2.0:1788587027.460386:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587027.460405:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587027.460410:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208172032:0@lo:400:kworker.0 00000100:00100000:2.0:1788587027.460429:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587027.460475:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172160 00000100:00100000:2.0:1788587027.460480:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172160 00000100:00100000:2.0:1788587027.460510:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587027.460516:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208172160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587027.460720:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208172160:12345-0@lo:400:kworker.0 Request processed in 203us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587027.460727:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788587027.460757:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83050000 x1875469208172160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587027.460774:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208172160:0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.467225:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208171648 00000100:00100000:0.0:1788587027.467242:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208171648 00000100:00100000:0.0:1788587027.467312:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788587027.467323:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208171648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.467431:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208171648:12345-0@lo:400:kworker.0 Request processed in 110us (7098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587027.467439:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:0.0:1788587027.467474:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587027.467487:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172032 00000100:00100000:0.0:1788587027.467492:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172032 00000100:00100000:0.0:1788587027.467530:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788587027.467537:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208172032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.467586:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208172032:12345-0@lo:400:kworker.0 Request processed in 50us (7155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587027.467593:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788587027.467612:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587027.467660:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208172032:0@lo:400:kworker.0 00000100:00100000:0.0:1788587027.467673:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208171648:0@lo:400:kworker.0 00000100:00100000:2.0:1788587027.971255:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208172288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587027.971340:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587027.972465:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172288 00000100:00100000:3.0:1788587027.972479:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172288 00000100:00100000:3.0:1788587027.972622:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788587027.972633:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208172288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587027.972680:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587027.972773:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208172288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587027.972780:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788587027.972865:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacc1ab0a80 x1875469208172288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587043 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587027.972892:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208172288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587028.166208:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587029.198794:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587029.527299:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587029.527347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587029.527378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587029.527405:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587029.527408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923712 00000100:00100000:3.0:1788587029.527420:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923712 00000100:00100000:2.0:1788587029.527455:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587029.527483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00100000:2.0:1788587029.527488:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923968 00000100:00100000:2.0:1788587029.527494:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923968 00000100:00100000:3.0:1788587029.527498:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181923712:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587029.527555:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181923840 00000100:00100000:2.0:1788587029.527559:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181923840 00000100:00100000:3.0:1788587029.527576:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181923712:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587029.527597:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00100000:2.0:1788587029.527601:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:2.0:1788587029.527614:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181923968:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587029.527651:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181923968:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587029.527658:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:2.0:1788587029.527682:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:2.0:1788587029.527688:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181923840:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587029.527712:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181923840:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587029.527726:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:2.0:1788587029.527745:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924224 00000100:00100000:2.0:1788587029.527749:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924224 00000100:00100000:2.0:1788587029.527786:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924096 00000100:00100000:2.0:1788587029.527790:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924096 00000100:00100000:2.0:1788587029.527804:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:2.0:1788587029.527810:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181924224:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587029.527839:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181924224:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587029.527876:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:2.0:1788587029.527887:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1788587029.527894:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181924096:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587029.527941:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181924096:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 46us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587029.527947:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00080000:2.0:1788587029.527970:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587029.527975:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587029.527978:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587030.217323:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587031.239416:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587032.259496:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587032.579351:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208172416:0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.579446:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587032.579508:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587032.579515:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208172800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.579559:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587032.579593:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208172672:0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.579637:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587032.579658:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587032.579664:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208172544:0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.579687:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587032.579734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172416 00000100:00100000:0.0:1788587032.579744:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172416 00000100:00100000:0.0:1788587032.579800:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788587032.579810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208172416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.579887:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208172416:12345-0@lo:400:kworker.0 Request processed in 78us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587032.579894:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788587032.580046:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172672 00000100:00100000:1.0:1788587032.580052:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172672 00000100:00100000:1.0:1788587032.580103:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172544 00000100:00100000:1.0:1788587032.580106:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172544 00000100:00080000:2.0:1788587032.580175:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587032.580192:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788587032.580202:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208172672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587032.580258:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208172672:12345-0@lo:400:kworker.0 Request processed in 60us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587032.580265:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788587032.580562:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587032.580573:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208172928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587032.580627:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587032.580666:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208173056:0@lo:400:kworker.0 00000100:00100000:3.0:1788587032.580693:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587032.580725:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587032.580730:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208173184:0@lo:400:kworker.0 00000100:00100000:3.0:1788587032.580755:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587032.580786:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172928 00000100:00100000:3.0:1788587032.580790:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172928 00000100:00100000:3.0:1788587032.580836:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587032.580863:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208172928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587032.580910:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587032.580950:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208172928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587032.580957:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587032.580976:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173056 00000100:00100000:3.0:1788587032.580980:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173056 00000100:00100000:3.0:1788587032.581007:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587032.581013:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208173056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587032.581050:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208173056:12345-0@lo:400:kworker.0 Request processed in 38us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587032.581057:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788587032.581078:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208172800 00000100:00100000:3.0:1788587032.581082:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208172800 00000100:00100000:1.0:1788587032.581237:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587032.581245:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208172544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587032.581286:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208172544:12345-0@lo:400:kworker.0 Request processed in 43us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587032.581294:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587032.581830:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173184 00000100:00100000:3.0:1788587032.581835:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173184 00000100:00100000:3.0:1788587032.581873:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587032.581879:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208172800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587032.581915:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208172800:12345-0@lo:400:kworker.0 Request processed in 36us (2356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587032.581921:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587032.581933:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788587032.581939:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208173184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587032.581965:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208173184:12345-0@lo:400:kworker.0 Request processed in 27us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587032.581971:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788587032.581992:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587032.581998:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587032.582001:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788587032.582040:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83050000 x1875469208172928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587032.582065:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208172928:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788587032.582111:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44faa00 x1875469208173184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587032.582191:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208173184:0@lo:400:kworker.0 00000100:00100000:3.0:1788587032.582205:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208173056:0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.582321:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208172544:0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.582336:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208172672:0@lo:400:kworker.0 00010000:00080000:0.0:1788587032.582366:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb44fbb80 x1875469208172800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587032.582387:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208172800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587032.582400:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208172416:0@lo:400:kworker.0 00000100:00100000:2.0:1788587033.091340:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208173312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587033.091436:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587033.091579:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173312 00000100:00100000:2.0:1788587033.091589:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173312 00000100:00100000:2.0:1788587033.091649:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788587033.091659:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208173312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587033.091710:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587033.091778:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208173312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587033.091785:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788587033.091831:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83050000 x1875469208173312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587033.091879:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208173312:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788587033.283321:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587034.314150:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587034.636125:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587034.636329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587034.636369:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587034.636403:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587034.636451:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587034.636499:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924608 00000100:00100000:1.0:1788587034.636509:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924608 00000100:00100000:1.0:1788587034.636572:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924480 00000100:00100000:1.0:1788587034.636575:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924480 00000100:00100000:1.0:1788587034.636617:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:1.0:1788587034.636628:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181924608:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587034.636719:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181924608:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 93us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.636726:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:1.0:1788587034.636743:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1788587034.636750:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181924480:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587034.636771:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181924480:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 22us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.636776:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1788587034.636795:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924864 00000100:00100000:1.0:1788587034.636799:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924864 00000100:00100000:1.0:1788587034.636872:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924736 00000100:00100000:1.0:1788587034.636876:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924736 00000100:00100000:1.0:1788587034.636893:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:1.0:1788587034.636899:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181924864:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587034.636927:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181924864:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.636932:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:1.0:1788587034.636943:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:1.0:1788587034.636948:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc98d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181924736:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587034.636983:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc98d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181924736:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 35us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587034.636989:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00080000:1.0:1788587034.637151:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587034.638990:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587034.639000:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587034.643091:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924352 00000100:00100000:3.0:1788587034.643113:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924352 00000100:00100000:2.0:1788587034.646493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 227 00000100:00100000:2.0:1788587034.646508:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181924352:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587034.646602:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181924352:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 97us (10486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587034.646610:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 227 00010000:00010000:1.0:1788587035.331471:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587036.355541:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587037.384012:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587037.700138:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208173568:0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.700244:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587037.700311:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208174080:0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.700340:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587037.700374:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587037.700380:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208173696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.700403:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587037.700420:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587037.700426:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208174208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587037.700453:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587037.700571:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173568 00000100:00100000:2.0:1788587037.700572:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174208 00000100:00100000:2.0:1788587037.700580:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174208 00000100:00100000:0.0:1788587037.700580:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173568 00000100:00100000:0.0:1788587037.700636:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173696 00000100:00100000:2.0:1788587037.700640:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788587037.700640:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173696 00000100:00100000:2.0:1788587037.700650:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208174208:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587037.700661:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788587037.700666:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208173568:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788587037.700695:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587037.700714:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208173568:12345-0@lo:400:kworker.0 Request processed in 48us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587037.700721:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788587037.700730:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208174208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587037.700735:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788587037.700740:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587037.700747:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208173696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.700782:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208173696:12345-0@lo:400:kworker.0 Request processed in 36us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587037.700788:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1788587037.700835:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbf98c000 x1875469208174208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587037.700882:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208174208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587037.700898:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208173696:0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.700923:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208173568:0@lo:400:kworker.0 00000100:00100000:3.0:1788587037.701322:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208173824:0@lo:400:kworker.0 00000100:00100000:3.0:1788587037.701360:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587037.701391:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587037.701398:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208173440:0@lo:400:kworker.0 00000100:00100000:3.0:1788587037.701428:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587037.701464:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208173952:0@lo:400:kworker.0 00000100:00100000:3.0:1788587037.701489:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587037.701497:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173440 00000100:00100000:2.0:1788587037.701502:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173440 00000100:00100000:2.0:1788587037.701535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788587037.701542:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208173440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587037.701592:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208173440:12345-0@lo:400:kworker.0 Request processed in 50us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587037.701611:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788587037.701684:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174080 00000100:00100000:0.0:1788587037.701689:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174080 00000100:00100000:0.0:1788587037.701727:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173824 00000100:00100000:0.0:1788587037.701730:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173824 00000100:00100000:0.0:1788587037.701742:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788587037.701747:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208174080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587037.701903:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587037.701913:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788587037.702036:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208173440:0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.702207:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208174080:12345-0@lo:400:kworker.0 Request processed in 459us (1866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587037.702215:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788587037.702229:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788587037.702236:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208173824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.702269:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208173824:12345-0@lo:400:kworker.0 Request processed in 34us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587037.702275:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788587037.702302:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4b4df80 x1875469208173824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587037.702313:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208173824:0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.702343:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208173952 00000100:00100000:0.0:1788587037.702347:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208173952 00010000:00080000:2.0:1788587037.703182:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb4b4d500 x1875469208174080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587037.703198:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208174080:0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.703960:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788587037.703979:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208173952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587037.704254:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208173952:12345-0@lo:400:kworker.0 Request processed in 282us (2761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587037.704262:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788587037.708435:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208173952:0@lo:400:kworker.0 00000100:00080000:2.0:1788587037.708896:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587037.708904:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587037.708907:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587038.213099:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587038.213123:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208174336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587038.213196:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587038.213261:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174336 00000100:00100000:1.0:1788587038.213269:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174336 00000100:00100000:1.0:1788587038.213322:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788587038.213331:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208174336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587038.213372:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587038.213492:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208174336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587038.213500:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788587038.213547:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadf800 x1875469208174336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587038.213565:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208174336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587038.404951:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587039.430606:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587039.756178:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587039.756222:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587039.756254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587039.756278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587039.756303:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587039.756350:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181925376 00000100:00100000:1.0:1788587039.756363:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181925376 00000100:00100000:1.0:1788587039.756426:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181925504 00000100:00100000:1.0:1788587039.756429:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181925504 00000100:00100000:1.0:1788587039.756487:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:1.0:1788587039.756500:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2358:x1875469181925376:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:1.0:1788587039.756537:0:6706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88b13 00000100:00080000:1.0:1788587039.756549:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc33000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587039.756614:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788587039.757073:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+2:2358:x1875469181925376:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 573us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587039.757083:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:1.0:1788587039.757105:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1788587039.757113:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2358:x1875469181925504:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:1.0:1788587039.757128:0:6706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88b1a 00000100:00080000:1.0:1788587039.757134:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc33800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788587039.757155:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788587039.757348:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+2:2358:x1875469181925504:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 235us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587039.757354:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00080000:1.0:1788587039.757384:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587039.757389:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788587039.757403:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587039.757523:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587039.758086:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181924992 00000100:00100000:2.0:1788587039.758100:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181924992 00000100:00100000:2.0:1788587039.758167:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 229 00000100:00100000:2.0:1788587039.758180:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181924992:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587039.758233:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181924992:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 58us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587039.758240:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 229 00000100:00100000:3.0:1788587039.759349:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181925248 00000100:00100000:3.0:1788587039.759360:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181925248 00000100:00100000:3.0:1788587039.759428:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181925120 00000100:00100000:3.0:1788587039.759431:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181925120 00000100:00100000:3.0:1788587039.759462:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00080000:2.0:1788587039.759610:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587039.759637:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181925248:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587039.759710:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181925248:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 228us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587039.759717:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:3.0:1788587039.759737:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:3.0:1788587039.759743:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181925120:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587039.759768:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181925120:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 26us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587039.759775:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 88 00010000:00010000:0.0:1788587040.452778:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587041.475164:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587042.499488:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587042.819773:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208174592:0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.820065:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587042.820118:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208175104:0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.820149:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587042.820177:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788587042.820197:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208174720:0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.820222:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587042.820240:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208175232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.820262:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587042.820295:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174592 00000100:00100000:1.0:1788587042.820303:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174592 00000100:00100000:1.0:1788587042.820351:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788587042.820360:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208174592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.820411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208174592:12345-0@lo:400:kworker.0 Request processed in 52us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587042.820418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788587042.820454:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208175104 00000100:00100000:1.0:1788587042.820457:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208175104 00000100:00100000:1.0:1788587042.820486:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174720 00000100:00100000:1.0:1788587042.820489:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174720 00000100:00100000:1.0:1788587042.820524:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587042.820532:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208175104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587042.821013:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208174464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587042.821650:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208174848:0@lo:400:kworker.0 00000100:00100000:0.0:1788587042.825730:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587042.825789:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208174976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587042.825825:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587042.826229:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208175232 00000100:00100000:0.0:1788587042.826238:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208175232 00000100:00100000:0.0:1788587042.826289:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174976 00000100:00100000:0.0:1788587042.826292:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174976 00000100:00100000:0.0:1788587042.826315:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788587042.826324:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208175232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587042.826384:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208175232:12345-0@lo:400:kworker.0 Request processed in 60us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587042.826392:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788587042.826409:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788587042.826415:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208174976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587042.826460:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208174976:12345-0@lo:400:kworker.0 Request processed in 30us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587042.826477:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788587042.826582:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbb66c000 x1875469208174976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587042.826597:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208174976:0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.826909:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208175104:12345-0@lo:400:kworker.0 Request processed in 6376us (6757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587042.826919:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788587042.826954:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788587042.826963:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208174720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.827004:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208174720:12345-0@lo:400:kworker.0 Request processed in 43us (6781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587042.827010:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788587042.827036:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587042.827041:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587042.827052:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587042.827310:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208174720:0@lo:400:kworker.0 00010000:00080000:1.0:1788587042.827326:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbb66fb80 x1875469208175232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587042.827336:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208175232:0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.827346:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208174592:0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.827357:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208175104:0@lo:400:kworker.0 00000100:00100000:3.0:1788587042.839614:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174464 00000100:00100000:3.0:1788587042.839634:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174464 00000100:00100000:3.0:1788587042.839701:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587042.839714:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208174464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587042.839760:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587042.839878:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208174464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (14157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587042.839885:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587042.840301:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587042.840706:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208174848 00000100:00100000:1.0:1788587042.840713:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208174848 00000100:00100000:1.0:1788587042.840760:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788587042.840768:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208174848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587042.840817:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208174848:12345-0@lo:400:kworker.0 Request processed in 51us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587042.840824:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788587042.843641:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587042.846191:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadce00 x1875469208174464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587042.846229:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208174464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587042.851074:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208174848:0@lo:400:kworker.0 00000001:00100000:1.0:1788587042.922049:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab703820-03cd-48f7-bca8-7e3164455d6c 00000020:00000080:1.0:1788587042.922062:0:6730:0:(genops.c:885:class_export_put()) final put ffff8bacbbc30000/ab703820-03cd-48f7-bca8-7e3164455d6c 00000020:00000080:1.0:1788587042.922094:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc30000/ab703820-03cd-48f7-bca8-7e3164455d6c for lustre-OST0000 00000020:00000080:1.0:1788587042.922135:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbbc33000 for lustre-OST0000 00000100:00100000:1.0:1788587043.339973:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208175360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587043.341105:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587043.341224:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208175360 00000100:00100000:1.0:1788587043.341234:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208175360 00000100:00100000:1.0:1788587043.341293:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788587043.341303:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208175360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587043.341341:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587043.341400:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208175360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587043.341408:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788587043.341448:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacaf1bd180 x1875469208175360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587043.341468:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208175360:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788587043.408517:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab703820-03cd-48f7-bca8-7e3164455d6c 00000020:00000080:0.0:1788587043.408527:0:7665:0:(genops.c:885:class_export_put()) final put ffff8bacbbc36800/ab703820-03cd-48f7-bca8-7e3164455d6c 00000020:00000080:1.0:1788587043.408602:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc36800/ab703820-03cd-48f7-bca8-7e3164455d6c for lustre-OST0001 00000020:00000080:1.0:1788587043.408648:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbbc33800 for lustre-OST0001 00010000:00010000:2.0:1788587043.527203:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587044.566057:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587044.881982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587044.882036:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587044.882215:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181925632 00000100:00100000:0.0:1788587044.882237:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181925632 00000100:00100000:0.0:1788587044.882294:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 231 00000100:00100000:0.0:1788587044.882305:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181925632:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587044.882386:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181925632:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 83us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587044.882393:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 231 00000100:00100000:2.0:1788587044.883007:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181925888 00000100:00100000:2.0:1788587044.883014:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181925888 00000100:00100000:2.0:1788587044.883078:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:2.0:1788587044.883090:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181925888:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587044.883240:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181925888:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 152us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587044.883248:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00080000:2.0:1788587044.883287:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587044.885622:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587044.885759:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181925760 00000100:00100000:1.0:1788587044.885769:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181925760 00000100:00100000:1.0:1788587044.885838:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:1.0:1788587044.885867:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181925760:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587044.885940:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181925760:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587044.885948:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00080000:2.0:1788587044.886893:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788587045.352149:0:11042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788587045.572595:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587046.599103:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587047.619313:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587047.942492:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208175488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587047.942569:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587047.945886:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208175488 00000100:00100000:1.0:1788587047.945903:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208175488 00000100:00100000:1.0:1788587047.945971:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788587047.945981:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208175488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587047.946021:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587047.946109:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208175488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587047.946130:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788587047.946157:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788587047.946201:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbf98c700 x1875469208175488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587047.946224:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208175488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587047.946454:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208175872:0@lo:400:kworker.0 00000100:00100000:2.0:1788587047.946498:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587047.946547:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587047.946553:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208176000:0@lo:400:kworker.0 00000100:00100000:2.0:1788587047.946576:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587047.946608:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208175872 00000100:00100000:2.0:1788587047.946613:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208175872 00000100:00100000:2.0:1788587047.946643:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208176000 00000100:00100000:2.0:1788587047.946645:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208176000 00000100:00100000:2.0:1788587047.946663:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788587047.946670:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208175872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587047.946708:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208175872:12345-0@lo:400:kworker.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587047.946715:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788587047.946727:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788587047.946732:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208176000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587047.946768:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208176000:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587047.946775:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788587047.946799:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208176000:0@lo:400:kworker.0 00000100:00100000:2.0:1788587047.946808:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208175872:0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.947491:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208175616:0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.947619:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587047.947649:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208176128:0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.947675:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587047.947697:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587047.947703:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208175744:0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.947727:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587047.947761:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208175744 00000100:00100000:1.0:1788587047.947767:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208175744 00000100:00100000:1.0:1788587047.947794:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788587047.947801:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208175744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.947869:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208175744:12345-0@lo:400:kworker.0 Request processed in 67us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587047.947876:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788587047.947893:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587047.947908:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208175616 00000100:00100000:1.0:1788587047.947911:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208175616 00000100:00100000:1.0:1788587047.947933:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788587047.947939:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208175616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.947966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208175616:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587047.947981:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788587047.948010:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208176128 00000100:00100000:1.0:1788587047.948014:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208176128 00000100:00100000:1.0:1788587047.948044:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587047.948050:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208176128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.948079:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208176128:12345-0@lo:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587047.948084:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587047.948113:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208175744:0@lo:400:kworker.0 00000100:00100000:1.0:1788587047.948122:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208175616:0@lo:400:kworker.0 00010000:00080000:1.0:1788587047.948133:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbf98fb80 x1875469208176128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587047.948143:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208176128:0@lo:400:kworker.0 00000100:00080000:1.0:1788587047.948165:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587048.458749:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208176256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587048.458838:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587048.459763:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208176256 00000100:00100000:1.0:1788587048.459772:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208176256 00000100:00100000:1.0:1788587048.459837:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788587048.459877:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208176256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587048.459921:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587048.459985:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208176256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587048.459992:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788587048.460293:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac8a7f2300 x1875469208176256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587048.460316:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208176256:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587048.643147:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587049.319100:0:11191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3d34ce30 20000000:00000080:2.0:1788587049.319123:0:11191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bacbfacfc00 uarg=0000000000000000 20000000:01000000:2.0:1788587049.319249:0:11191:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587049.319258:0:11191:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788587049.319265:0:11191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788587049.320245:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788587049.320519:0:11191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788587049.326734:0:11191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788587049.326768:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.326790:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.326800:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.326807:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.326813:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.326820:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.327006:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.327064:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.327082:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 12 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587049.327101:0:11191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176384:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587049.327249:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.327257:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 18 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587049.327267:0:11191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176512:0@lo:104: 00000100:00100000:2.0:1788587049.327323:0:11191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587049.327406:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.327416:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587049.327424:0:11191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176640:0@lo:104: 00000100:00100000:2.0:1788587049.327446:0:11191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587049.332938:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587049.333006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926016 00000100:00100000:3.0:1788587049.333017:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926016 00010000:00010000:3.0:1788587049.333069:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 13 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587049.333116:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:3.0:1788587049.333128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88341850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181926016:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587049.333149:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587049.333156:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 13 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.333170:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 13 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.333194:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587049.333259:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88341850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181926016:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 132us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587049.333266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00010000:00010000:2.0:1788587049.334863:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.334899:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 18 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587049.334925:0:11191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176768:0@lo:104: 00000100:00100000:2.0:1788587049.334975:0:11191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587049.335169:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208176512 00000100:00100000:1.0:1788587049.335177:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208176512 00000100:00100000:1.0:1788587049.335217:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208176640 00000100:00100000:1.0:1788587049.335220:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208176640 00000100:00100000:1.0:1788587049.335235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587049.335245:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:11191:x1875469208176512:12345-0@lo:104: 00010000:00010000:1.0:1788587049.335260:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587049.335386:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788587049.335392:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:11191:x1875469208176512:12345-0@lo:104: Request processed in 149us (8070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587049.335400:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587049.335417:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587049.335423:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11191:x1875469208176640:12345-0@lo:104: 00010000:00010000:1.0:1788587049.335433:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.335649:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.335662:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 12 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587049.335673:0:11191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176896:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587049.335729:0:11191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacc1800a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788587049.335756:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab88b05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26be expref: 12 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587049.335773:0:11191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176384:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587049.335785:0:11191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176512:0@lo:104: 00000100:00100000:2.0:1788587049.335792:0:11191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176640:0@lo:104: 00010000:00010000:3.0:1788587049.335874:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587049.335881:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.335902:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587049.335905:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.335915:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587049.335921:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587049.335927:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587049.335960:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.335967:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587049.335993:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.335999:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5200/0xc1a730b05ab88ae9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88af0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336009:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587049.336012:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336017:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5c00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587049.336020:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336037:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587049.336043:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587049.336048:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587049.336062:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336068:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587049.336073:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336079:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5c00/0xc1a730b05ab88adb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88ae2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336088:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587049.336089:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587049.336091:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587049.336104:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208177024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587049.336152:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587049.336178:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587049.336183:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208177152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587049.336201:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587049.336230:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177024 00000100:00100000:3.0:1788587049.336234:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177024 00010000:00010000:3.0:1788587049.336253:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 19 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587049.336536:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788587049.336544:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11191:x1875469208176640:12345-0@lo:104: Request processed in 1121us (9096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587049.336551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788587049.336566:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208176768 00000100:00100000:1.0:1788587049.336569:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208176768 00000100:00100000:1.0:1788587049.336593:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788587049.336599:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11191:x1875469208176768:12345-0@lo:104: 00010000:00010000:1.0:1788587049.336608:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587049.336663:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177152 00000100:00100000:3.0:1788587049.336667:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177152 00010000:00010000:3.0:1788587049.336680:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 20 pid: 5845 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587049.336701:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587049.336707:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+20:3312:x1875469208177024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587049.336717:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587049.336722:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 20 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336733:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 20 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336749:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab88af0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88ae9 expref: 20 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336761:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587049.336788:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208177024:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587049.336794:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587049.336807:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587049.336813:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3312:x1875469208177152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587049.336821:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587049.336825:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336833:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336869:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d4a00/0xc1a730b05ab88ae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88adb expref: 18 pid: 5845 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587049.336878:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587049.336900:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3312:x1875469208177152:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587049.336906:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587049.336942:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208177152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587049.336950:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208177024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587049.338091:0:11191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176768:0@lo:104: 00010000:00010000:2.0:1788587049.338688:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587049.338699:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.338710:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98400 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:2.0:1788587049.338713:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.338740:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788587049.338747:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587049.338753:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788587049.338813:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.338820:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788587049.338871:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.338878:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98400/0xc1a730b05ab88acd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88ad4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.338895:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587049.338897:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587049.338899:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587049.338909:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587049.338924:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208177280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587049.338988:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587049.339036:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177280 00000100:00100000:2.0:1788587049.339042:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177280 00010000:00010000:2.0:1788587049.339072:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 17 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587049.339101:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788587049.339109:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3315:x1875469208177280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587049.339127:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587049.339132:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 17 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.339272:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 17 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.339356:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab88ad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88acd expref: 17 pid: 5844 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.339369:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587049.339456:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3315:x1875469208177280:12345-0@lo:103:ldlm_bl.0 Request processed in 347us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587049.339463:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1788587049.340673:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788587049.340687:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11191:x1875469208176768:12345-0@lo:104: Request processed in 4085us (5708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587049.340696:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788587049.340760:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587049.341087:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208177280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587049.342484:0:11191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1875469208176896:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587049.342518:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587049.343026:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587049.343124:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926144 00000100:00100000:0.0:1788587049.343132:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926144 00010000:00010000:0.0:1788587049.343166:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 12 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587049.343190:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:0.0:1788587049.343207:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:2362:x1875469181926144:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587049.343220:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587049.343226:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 12 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343237:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 12 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343256:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88ac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2686 expref: 12 pid: 5844 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343272:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343291:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343307:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343315:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343322:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343328:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343334:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587049.343338:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343353:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343382:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587049.343394:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587049.343454:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:2362:x1875469181926144:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 247us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587049.343462:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00010000:00010000:2.0:1788587049.343523:0:11191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.343532:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.343538:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d4400/0xc1a730b05ab88b21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587049.668627:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587050.009044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587050.009103:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587050.009223:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926400 00000100:00100000:2.0:1788587050.009235:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926400 00000100:00100000:2.0:1788587050.009316:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:2.0:1788587050.009327:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181926400:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587050.009420:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181926400:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 95us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.009441:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:1.0:1788587050.009530:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926272 00000100:00100000:1.0:1788587050.009535:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926272 00000100:00100000:1.0:1788587050.009574:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 233 00000100:00100000:1.0:1788587050.009582:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:2359:x1875469181926272:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587050.009615:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:2359:x1875469181926272:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587050.009622:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 233 00000100:00080000:3.0:1788587050.009925:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587050.015791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587050.016252:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926528 00000100:00100000:2.0:1788587050.016264:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926528 00000100:00100000:2.0:1788587050.016354:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:2.0:1788587050.016375:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181926528:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587050.016465:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181926528:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 101us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.016472:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00080000:3.0:1788587050.016627:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587050.445610:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587050.445650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926656 00000100:00100000:3.0:1788587050.445662:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926656 00000100:00100000:3.0:1788587050.445715:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:3.0:1788587050.445724:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:5605:x1875469181926656:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587050.445744:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587050.445762:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c26e8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.445798:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.445811:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.445821:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5600, rc 0) 00000100:00100000:3.0:1788587050.445891:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181926656:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 168us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.445898:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:0.0:1788587050.459227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587050.463421:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926784 00000100:00100000:2.0:1788587050.463438:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926784 00000100:00100000:2.0:1788587050.463501:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 235 00000100:00100000:2.0:1788587050.463512:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181926784:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587050.463862:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181926784:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 331us (4732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.463870:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 235 00000100:00100000:3.0:1788587050.468332:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587050.468493:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181926912 00000100:00100000:1.0:1788587050.468503:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181926912 00000100:00100000:1.0:1788587050.468558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00100000:1.0:1788587050.468568:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181926912:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.468818:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181926912:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 250us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587050.468828:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00100000:1.0:1788587050.475460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587050.475877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927040 00000100:00100000:3.0:1788587050.475889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927040 00000100:00100000:3.0:1788587050.475950:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 237 00000100:00100000:3.0:1788587050.475963:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181927040:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587050.475984:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587050.476004:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c26ef expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.476036:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.476050:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.476060:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4e00, rc 0) 00000100:00100000:3.0:1788587050.476136:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181927040:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 176us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.476153:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 237 00000100:00100000:3.0:1788587050.483719:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587050.483758:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927168 00000100:00100000:3.0:1788587050.483769:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927168 00000100:00100000:3.0:1788587050.483817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:3.0:1788587050.483826:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181927168:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.484162:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181927168:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 336us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.484171:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:2.0:1788587050.493595:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587050.496781:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927296 00000100:00100000:3.0:1788587050.496796:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927296 00000100:00100000:2.0:1788587050.497002:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00100000:2.0:1788587050.497014:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181927296:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587050.497261:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181927296:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 248us (3679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.497270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 239 00010000:00010000:2.0:1788587050.691041:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788587050.883006:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587050.883014:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacbb896000 from 7 10000000:01000000:3.0:1788587050.883020:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587050.883083:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.883096:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.883118:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587050.883150:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.883237:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587050.883311:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587050.883383:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177408 00000100:00100000:0.0:1788587050.883394:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177408 00000100:00100000:0.0:1788587050.883452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788587050.883463:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208177408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587050.883479:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587050.883494:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88b36 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587050.883520:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587050.883531:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587050.883542:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99400, rc 0) 00000100:00100000:0.0:1788587050.883617:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208177408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587050.883624:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788587050.884147:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587050.884189:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.884198:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587050.884414:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.884459:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587050.884538:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788587050.884978:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177536 00000100:00100000:0.0:1788587050.884985:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177536 00000100:00100000:2.0:1788587050.885410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788587050.885423:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208177536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587050.886319:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208177536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 894us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.886332:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788587050.886640:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.886771:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.886830:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587050.886978:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587050.887246:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177664 00000100:00100000:2.0:1788587050.887323:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177664 00000100:00100000:2.0:1788587050.887437:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788587050.887449:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208177664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587050.887672:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208177664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587050.887680:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788587050.887773:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587050.888597:0:11222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788587050.888867:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788587050.888898:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587050.888909:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.888921:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587050.888929:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587050.888932:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacaf3ef800 from 7 10000000:01000000:1.0:1788587050.888934:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587050.888968:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.888976:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.888986:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587050.889007:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.889057:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587050.890453:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a9aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587050.890506:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177792 00000100:00100000:0.0:1788587050.890516:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177792 00000100:00100000:3.0:1788587050.890740:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788587050.890752:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208177792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587050.890768:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587050.890786:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88b44 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.890812:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.890824:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587050.890871:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4000, rc 0) 00000100:00100000:3.0:1788587050.890934:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208177792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.890941:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788587050.891094:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587050.891357:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.891369:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587050.891443:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.891487:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587050.891519:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587050.891581:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208177920 00000100:00100000:3.0:1788587050.891586:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208177920 00000100:00100000:3.0:1788587050.891659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788587050.891667:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208177920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.891984:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208177920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 317us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.891993:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788587050.892415:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208177920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.892455:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.892499:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587050.892530:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587050.892640:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178048 00000100:00100000:3.0:1788587050.892645:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178048 00000100:00100000:3.0:1788587050.892674:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788587050.892681:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208178048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.892916:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208178048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.892923:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788587050.893440:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587050.896778:0:11223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788587050.901234:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788587050.901403:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587050.901415:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.901428:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587050.901441:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587050.901444:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac83941800 from 7 10000000:01000000:1.0:1788587050.901448:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587050.901501:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.901509:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.901520:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587050.901548:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.902499:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587050.902549:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a9aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587050.902870:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178176 00000100:00100000:0.0:1788587050.902879:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178176 00000100:00100000:0.0:1788587050.902937:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788587050.902947:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208178176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587050.902962:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587050.902983:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88b52 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587050.903011:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587050.903024:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587050.903034:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788587050.903103:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208178176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587050.903118:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788587050.903498:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587050.903519:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587050.903529:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587050.903994:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.904049:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587050.904088:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a9aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587050.904495:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178304 00000100:00100000:2.0:1788587050.904502:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178304 00000100:00100000:2.0:1788587050.905010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788587050.905026:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208178304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587050.905409:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208178304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587050.905684:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.905733:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587050.905779:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587050.905817:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587050.905990:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178432 00000100:00100000:3.0:1788587050.905997:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178432 00000100:00100000:2.0:1788587050.906494:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788587050.906659:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788587050.906670:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208178432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587050.906879:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208178432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587050.906886:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788587050.906994:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208178432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587050.908657:0:11224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788587050.908886:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788587050.912891:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587050.912909:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587050.912938:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587051.718294:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587052.738986:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587053.059719:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587053.059752:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208178560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587053.059833:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.059949:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178560 00000100:00100000:3.0:1788587053.059959:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178560 00000100:00100000:3.0:1788587053.060029:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788587053.060040:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208178560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587053.060077:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587053.060133:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208178560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.060141:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788587053.060162:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788587053.060195:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac9071df80 x1875469208178560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587053.060215:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208178560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587053.067927:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208178688:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068017:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.068056:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208179200:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068081:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.068119:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587053.068126:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208178816:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068153:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.068191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178688 00000100:00100000:3.0:1788587053.068198:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178688 00000100:00100000:3.0:1788587053.068263:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788587053.068271:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208178688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208178688:12345-0@lo:400:kworker.0 Request processed in 67us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.068345:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788587053.068378:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179200 00000100:00100000:3.0:1788587053.068382:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179200 00000100:00100000:3.0:1788587053.068418:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587053.068425:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208179200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068455:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208179200:12345-0@lo:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.068461:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587053.068480:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178816 00000100:00100000:3.0:1788587053.068483:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178816 00000100:00100000:3.0:1788587053.068505:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788587053.068511:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208178816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068538:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208178816:12345-0@lo:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.068543:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788587053.068562:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587053.068574:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208178944:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068601:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.068620:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587053.068625:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208179072:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068645:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.068677:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208178944 00000100:00100000:3.0:1788587053.068680:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208178944 00000100:00100000:3.0:1788587053.068717:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179072 00000100:00100000:3.0:1788587053.068720:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179072 00000100:00100000:3.0:1788587053.068735:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587053.068740:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208178944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068773:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208178944:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.068779:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788587053.068791:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788587053.068797:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208179072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068823:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208179072:12345-0@lo:400:kworker.0 Request processed in 27us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.068829:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788587053.068868:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587053.068905:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208178816:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068917:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208178688:0@lo:400:kworker.0 00010000:00080000:3.0:1788587053.068930:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac9071c000 x1875469208179200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587053.068940:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208179200:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068974:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208179072:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.068983:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208178944:0@lo:400:kworker.0 00000100:00100000:3.0:1788587053.575614:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587053.575638:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208179328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587053.575711:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587053.575782:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179328 00000100:00100000:3.0:1788587053.575802:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179328 00000100:00100000:3.0:1788587053.575870:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788587053.575879:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208179328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587053.575996:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587053.576044:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208179328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587053.576051:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788587053.576096:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac9071ce00 x1875469208179328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587053.576116:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208179328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587053.770593:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587054.150619:0:11388:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788587054.787347:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587055.132865:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587055.132935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587055.132967:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587055.133064:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927552 00000100:00100000:3.0:1788587055.133065:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927680 00000100:00100000:3.0:1788587055.133075:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927680 00000100:00100000:2.0:1788587055.133075:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927552 00000100:00100000:1.0:1788587055.133144:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927424 00000100:00100000:1.0:1788587055.133148:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927424 00000100:00100000:2.0:1788587055.133152:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:2.0:1788587055.133162:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181927552:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587055.133187:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 250 00000100:00100000:1.0:1788587055.133194:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181927424:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587055.133281:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181927424:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587055.133288:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 250 00000100:00100000:2.0:1788587055.133429:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181927552:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 268us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587055.133436:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:3.0:1788587055.140992:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:3.0:1788587055.141017:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181927680:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587055.141578:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181927680:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 569us (8606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587055.141587:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00080000:0.0:1788587055.143976:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587055.811084:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587056.835553:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587057.859477:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587058.178995:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208179456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587058.179068:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587058.179167:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179456 00000100:00100000:3.0:1788587058.179175:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179456 00000100:00080000:1.0:1788587058.179217:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587058.179252:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587058.179272:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208179456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587058.179307:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587058.179365:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208179456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587058.179372:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788587058.180797:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac9071ce00 x1875469208179456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587058.180824:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208179456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587058.187317:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208179584:0@lo:400:kworker.0 00000100:00100000:1.0:1788587058.187413:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587058.187481:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208180096:0@lo:400:kworker.0 00000100:00100000:0.0:1788587058.187494:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179584 00000100:00100000:0.0:1788587058.187504:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179584 00000100:00100000:1.0:1788587058.187510:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587058.187540:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587058.187548:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208179968:0@lo:400:kworker.0 00000100:00100000:0.0:1788587058.187570:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788587058.187577:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587058.187585:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208179584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587058.187608:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180096 00000100:00100000:1.0:1788587058.187613:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180096 00000100:00100000:0.0:1788587058.187651:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208179584:12345-0@lo:400:kworker.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587058.187657:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587058.187664:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788587058.187669:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208180096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587058.187707:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208180096:12345-0@lo:400:kworker.0 Request processed in 42us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587058.187714:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788587058.187734:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179968 00000100:00080000:1.0:1788587058.187738:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587058.187740:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179968 00000100:00100000:1.0:1788587058.187769:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208179584:0@lo:400:kworker.0 00000100:00100000:0.0:1788587058.187783:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00010000:00080000:1.0:1788587058.187788:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbb66d500 x1875469208180096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587058.187795:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208179968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587058.187810:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208180096:0@lo:400:kworker.0 00000100:00100000:0.0:1788587058.187874:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208179968:12345-0@lo:400:kworker.0 Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587058.187875:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208179968:0@lo:400:kworker.0 00000100:00100000:0.0:1788587058.187888:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788587058.187894:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587058.191604:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208179840:0@lo:400:kworker.0 00000100:00100000:2.0:1788587058.191684:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587058.191725:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587058.191731:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208179712:0@lo:400:kworker.0 00000100:00100000:2.0:1788587058.191753:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587058.191783:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179840 00000100:00100000:2.0:1788587058.191791:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179840 00000100:00100000:2.0:1788587058.191869:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208179712 00000100:00100000:2.0:1788587058.191873:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208179712 00000100:00100000:2.0:1788587058.191895:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587058.191922:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208179840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587058.191993:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208179840:12345-0@lo:400:kworker.0 Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587058.192001:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587058.192020:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587058.192026:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208179712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587058.192054:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208179712:12345-0@lo:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587058.192060:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788587058.192099:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208179712:0@lo:400:kworker.0 00000100:00100000:2.0:1788587058.192110:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208179840:0@lo:400:kworker.0 00000100:00080000:1.0:1788587058.197259:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587058.699267:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208180224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587058.699336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587058.700086:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180224 00000100:00100000:3.0:1788587058.700098:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180224 00000100:00100000:3.0:1788587058.700164:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788587058.700175:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208180224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587058.700223:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587058.700284:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208180224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587058.700292:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788587058.700333:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbb66f100 x1875469208180224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587058.700353:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb66f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208180224:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788587058.807564:0:11488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 01:44:16 (1788587056) === 00010000:00010000:3.0:1788587058.885317:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587059.043280:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587059.043323:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927936 00000100:00100000:0.0:1788587059.043332:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927936 00000100:00100000:0.0:1788587059.043411:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1788587059.043422:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:9691:x1875469181927936:12345-192.168.204.28@tcp:700:mkdir.0 00000100:00100000:0.0:1788587059.043498:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:9691:x1875469181927936:12345-192.168.204.28@tcp:700:mkdir.0 Request processed in 79us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587059.043505:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:0.0:1788587059.043545:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587059.043565:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181927808 00000100:00100000:0.0:1788587059.043568:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181927808 00000100:00100000:0.0:1788587059.043591:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:0.0:1788587059.043598:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181927808:12345-192.168.204.28@tcp:41:mkdir.0 00000004:00000024:0.0:1788587059.043628:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587059.043671:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181927808:12345-192.168.204.28@tcp:41:mkdir.0 Request processed in 74us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587059.043676:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00080000:1.0:1788587059.044284:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587059.045929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587059.046098:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181928192 00000100:00100000:1.0:1788587059.046109:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181928192 00000100:00100000:1.0:1788587059.046173:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1788587059.046185:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:9691:x1875469181928192:12345-192.168.204.28@tcp:36:mkdir.0 00010000:00010000:1.0:1788587059.046262:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587059.046342:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88a41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2671 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.046364:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac90439800) 00010000:00010000:1.0:1788587059.046376:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587059.046737:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.046752:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.046763:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.046794:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.046802:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.046808:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587059.053624:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587059.053646:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.053658:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.053665:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.053671:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587059.053676:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.053685:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.053704:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025800) 00010000:00010000:1.0:1788587059.053707:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587059.053714:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.053720:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587059.053748:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d80db5e0 reply state 000000008bf587bb transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587059.053759:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587059.056237:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:9691:x1875469181928192:12345-192.168.204.28@tcp:36:mkdir.0 Request processed in 10040us (10304us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788587059.057268:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00010000:00010000:0.0:1788587059.059278:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.059301:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.059310:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.059316:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587059.059323:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.059351:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.059372:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8baca1025d00) 00010000:00010000:0.0:1788587059.059375:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587059.059379:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.059385:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587059.067148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587059.067431:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181928320 00000100:00100000:1.0:1788587059.067443:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181928320 00000100:00100000:1.0:1788587059.067507:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1788587059.067519:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:9692:x1875469181928320:12345-192.168.204.28@tcp:101:chmod.0 00010000:00010000:1.0:1788587059.067891:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587059.067915:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c26f6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.067990:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.068005:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.068017:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587059.068052:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587059.068056:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587059.068093:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.068118:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26f6 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.068134:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26f6 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.068162:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025800) 00010000:00010000:1.0:1788587059.068166:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587059.068170:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52ac00, rc 0) 00000100:00100000:1.0:1788587059.068250:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:9692:x1875469181928320:12345-192.168.204.28@tcp:101:chmod.0 Request processed in 733us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587059.068257:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1788587059.076430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587059.076510:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181928576 00000100:00100000:0.0:1788587059.076523:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181928576 00000100:00100000:0.0:1788587059.076586:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:0.0:1788587059.076597:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:9692:x1875469181928576:12345-192.168.204.28@tcp:36:chmod.0 00010000:00010000:0.0:1788587059.076658:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587059.076691:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26f6 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.076712:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025800) 00010000:00010000:0.0:1788587059.076723:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587059.076747:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.076760:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.076770:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587059.077382:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b63013c reply state 00000000de25903b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587059.077393:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788587059.077474:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587059.077735:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:9692:x1875469181928576:12345-192.168.204.28@tcp:36:chmod.0 Request processed in 1138us (1313us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788587059.077750:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00010000:00010000:2.0:1788587059.080376:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.080394:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.080403:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.080409:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587059.080413:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.080421:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.080441:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:2.0:1788587059.080444:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587059.080449:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.080456:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88b7c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587059.103546:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.103669:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181928704 00000100:00100000:2.0:1788587059.103680:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181928704 00000100:00100000:2.0:1788587059.103748:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788587059.103760:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:9693:x1875469181928704:12345-192.168.204.28@tcp:101:chown.0 00010000:00010000:2.0:1788587059.103788:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587059.103824:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c26fd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.103937:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88b8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.103951:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.103963:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587059.103999:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587059.104003:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587059.104059:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.104088:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26fd expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.104108:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26fd expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.104117:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968b00) 00010000:00010000:2.0:1788587059.104120:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587059.104124:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5c00, rc 0) 00000100:00100000:2.0:1788587059.104177:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:9693:x1875469181928704:12345-192.168.204.28@tcp:101:chown.0 Request processed in 419us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587059.104184:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:3.0:1788587059.111421:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587059.111502:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181928832 00000100:00100000:1.0:1788587059.111512:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181928832 00000100:00100000:1.0:1788587059.111600:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:1.0:1788587059.111613:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:9693:x1875469181928832:12345-192.168.204.28@tcp:101:chown.0 00010000:00010000:1.0:1788587059.111638:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587059.111662:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2704 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111738:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111754:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111766:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111781:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111806:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111813:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111949:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111958:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.111965:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587059.111996:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587059.112000:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587059.112022:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112034:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112041:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112048:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112054:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ac00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587059.112058:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112073:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112087:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968b00) 00010000:00010000:1.0:1788587059.112091:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587059.112097:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112105:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88b98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112120:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112127:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112132:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112138:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587059.112141:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112147:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112154:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8baca1025100) 00010000:00010000:1.0:1788587059.112157:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587059.112160:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112177:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88b9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112226:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88b91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2704 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112240:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2704 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.112248:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587059.112250:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587059.112252:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52be00, rc 0) 00000100:00100000:1.0:1788587059.112312:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:9693:x1875469181928832:12345-192.168.204.28@tcp:101:chown.0 Request processed in 702us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587059.112320:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:0.0:1788587059.118280:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.118382:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181929088 00000100:00100000:2.0:1788587059.118477:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181929088 00000100:00100000:2.0:1788587059.118545:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1788587059.118556:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:9693:x1875469181929088:12345-192.168.204.28@tcp:36:chown.0 00010000:00010000:2.0:1788587059.118803:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587059.118834:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2704 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.118982:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:2.0:1788587059.118994:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587059.119028:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.119042:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.119053:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587059.195489:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027c54e5a reply state 00000000239c2d83 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587059.195507:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788587059.195524:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788587059.195643:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:9693:x1875469181929088:12345-192.168.204.28@tcp:36:chown.0 Request processed in 77084us (77368us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788587059.195653:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000001:00080000:3.0:1788587059.195677:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1788587059.195707:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1788587059.195726:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.195736:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.195760:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.195768:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587059.195773:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.195783:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.195802:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8baca0968c00) 00010000:00010000:2.0:1788587059.195805:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587059.195810:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.195818:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88bad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587059.220490:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587059.220725:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181929216 00000100:00100000:1.0:1788587059.220737:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181929216 00000100:00100000:1.0:1788587059.220798:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:1.0:1788587059.220808:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:9694:x1875469181929216:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:1.0:1788587059.220833:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587059.220893:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88bb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c270b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587059.228832:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7884us 00010000:00010000:3.0:1788587059.246311:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.246340:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.246649:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.246685:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.246694:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.246700:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247492:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247504:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247514:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587059.247544:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587059.247549:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587059.247727:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247743:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247751:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247758:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247776:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587059.247782:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247790:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247805:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968b00) 00010000:00010000:3.0:1788587059.247809:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587059.247814:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247822:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.247835:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248282:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248289:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248294:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587059.248297:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248304:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248326:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bac987bc800) 00010000:00010000:3.0:1788587059.248329:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587059.248332:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248338:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248621:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88bb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c270b expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248638:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c270b expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.248644:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:3.0:1788587059.248647:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788587059.248649:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5e00, rc 0) 00000100:00100000:3.0:1788587059.248770:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:9694:x1875469181929216:12345-192.168.204.28@tcp:101:touch.500 Request processed in 27962us (28292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587059.248779:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:0.0:1788587059.252387:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587059.252463:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181929472 00000100:00100000:1.0:1788587059.252474:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181929472 00000100:00100000:1.0:1788587059.252533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:1.0:1788587059.252543:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:9694:x1875469181929472:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:1.0:1788587059.252580:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587059.252602:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88bd0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2712 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.252902:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.252918:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.252930:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.252993:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.253002:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.253010:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587059.254312:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788587059.254808:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88be5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.254824:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.254835:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88be5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255384:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255392:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255400:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255406:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ac00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587059.255411:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255419:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255433:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:1.0:1788587059.255436:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587059.255441:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255449:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ac00/0xc1a730b05ab88bd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587059.255461:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b5bcd0b reply state 00000000975f1ff6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587059.255470:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788587059.255509:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88bd0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2712 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255537:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88be5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2712 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.255545:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8baca1025c00) 00010000:00010000:1.0:1788587059.255547:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587059.255550:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52b200, rc 0) 00000100:00100000:1.0:1788587059.256401:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:9694:x1875469181929472:12345-192.168.204.28@tcp:101:touch.500 Request processed in 3854us (4019us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788587059.256412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:1.0:1788587059.259965:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587059.260034:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181929728 00000100:00100000:3.0:1788587059.260046:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181929728 00000100:00100000:3.0:1788587059.260123:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:3.0:1788587059.260134:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:9694:x1875469181929728:12345-192.168.204.28@tcp:36:touch.500 00010000:00010000:3.0:1788587059.260225:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587059.260257:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2712 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.260294:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8baca1025c00) 00010000:00010000:3.0:1788587059.260306:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587059.260379:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.260441:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.260453:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587059.260613:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030c2342f reply state 00000000d89b57bd transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587059.260622:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587059.260732:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+11:9694:x1875469181929728:12345-192.168.204.28@tcp:36:touch.500 Request processed in 599us (776us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788587059.260740:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00010000:00010000:3.0:1788587059.262699:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.262714:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.262721:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.262728:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587059.262733:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.262755:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.262771:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8bac987bc800) 00010000:00010000:3.0:1788587059.262773:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587059.262778:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.262784:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88bf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.263024:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.263033:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.263039:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.263044:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587059.263048:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.263067:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.263078:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff8baca1025100) 00010000:00010000:2.0:1788587059.263081:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587059.263084:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.263089:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88bde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587059.264570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.264768:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181929856 00000100:00100000:2.0:1788587059.264779:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181929856 00000100:00100000:2.0:1788587059.264830:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:2.0:1788587059.264868:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:9694:x1875469181929856:12345-192.168.204.28@tcp:101:touch.500 00010000:00010000:2.0:1788587059.264895:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587059.264917:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88bfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2719 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.264983:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2719 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.264998:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88bfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2719 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.265018:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8baca0968c00) 00010000:00010000:2.0:1788587059.265021:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587059.265037:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5200, rc 0) 00000100:00100000:2.0:1788587059.265300:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:9694:x1875469181929856:12345-192.168.204.28@tcp:101:touch.500 Request processed in 258us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587059.265309:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:0.0:1788587059.272380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587059.273065:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181929984 00000100:00100000:3.0:1788587059.273077:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181929984 00000100:00100000:3.0:1788587059.273149:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:3.0:1788587059.273158:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875469181929984:12345-192.168.204.28@tcp:8:touch.500 00010000:00080000:3.0:1788587059.273207:0:6708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp t0 exp 0000000000000000 cur 381 last 0 00000020:00000080:3.0:1788587059.273242:0:6708:0:(genops.c:1385:class_connect()) connect: client 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8, cookie 0xc1a730b05ab88c01 00002000:00100000:3.0:1788587059.273259:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8/ffff8bacb48b6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587059.273270:0:6708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587059.273508:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587059.273544:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8bacb48b7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587059.273617:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2358:x1875469181929984:12345-192.168.204.28@tcp:8:touch.500 Request processed in 459us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587059.273625:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1788587059.280221:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587059.280301:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181930112 00000100:00100000:1.0:1788587059.280313:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181930112 00000100:00100000:1.0:1788587059.280407:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1788587059.280419:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:0:x1875469181930112:12345-192.168.204.28@tcp:2:touch.500 00000100:00080000:2.0:1788587059.280691:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788587059.312933:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1788587059.312960:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000100:00100000:1.0:1788587059.313563:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:0:x1875469181930112:12345-192.168.204.28@tcp:2:touch.500 Request processed in 33140us (33347us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788587059.313575:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1788587059.325315:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.325503:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181930368 00000100:00100000:2.0:1788587059.325514:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181930368 00000100:00100000:2.0:1788587059.325572:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1788587059.325583:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:9694:x1875469181930368:12345-192.168.204.28@tcp:35:touch.500 00000100:00100000:2.0:1788587059.326449:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+11:9694:x1875469181930368:12345-192.168.204.28@tcp:35:touch.500 Request processed in 864us (1142us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788587059.326458:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1788587059.361960:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587059.362060:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181930496 00000100:00100000:3.0:1788587059.362071:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181930496 00000100:00100000:3.0:1788587059.362135:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:3.0:1788587059.362162:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+11:9695:x1875469181930496:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:3.0:1788587059.362200:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587059.362228:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88c08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2720 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.362303:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.362318:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.362329:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587059.362364:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587059.362368:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587059.362411:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.362439:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab88c08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2720 expref: 13 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.362459:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2720 expref: 12 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.362476:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:3.0:1788587059.362480:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587059.362484:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5c00, rc 0) 00000100:00100000:2.0:1788587059.362621:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:9695:x1875469181930496:12345-192.168.204.28@tcp:101:rm.0 Request processed in 460us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587059.362629:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:1.0:1788587059.380786:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.381036:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181930752 00000100:00100000:2.0:1788587059.381047:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181930752 00000100:00100000:2.0:1788587059.381111:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:2.0:1788587059.381123:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:9695:x1875469181930752:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1788587059.381148:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587059.381173:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88c16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2727 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587059.381290:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587059.381467:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88c16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2727 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.381496:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968b00) 00010000:00010000:2.0:1788587059.381499:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587059.381505:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88c16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2727 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.381521:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4200, rc 0) 00000100:00100000:2.0:1788587059.381592:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:9695:x1875469181930752:12345-192.168.204.28@tcp:101:rm.0 Request processed in 472us (816us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788587059.381600:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:1.0:1788587059.393644:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587059.393946:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181930880 00000100:00100000:3.0:1788587059.393959:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181930880 00000100:00100000:3.0:1788587059.394058:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:3.0:1788587059.394070:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:9695:x1875469181930880:12345-192.168.204.28@tcp:37:rm.0 00000100:00100000:3.0:1788587059.405472:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:9695:x1875469181930880:12345-192.168.204.28@tcp:37:rm.0 Request processed in 10631us (11067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587059.405491:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:1.0:1788587059.419001:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.421475:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181931136 00000100:00100000:2.0:1788587059.421491:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181931136 00000100:00100000:2.0:1788587059.421569:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1788587059.421580:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84660850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:9695:x1875469181931136:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:2.0:1788587059.421902:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84660850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:9695:x1875469181931136:12345-192.168.204.28@tcp:35:rm.0 Request processed in 321us (2911us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788587059.421909:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1788587059.434656:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.435365:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181931392 00000100:00100000:2.0:1788587059.435379:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181931392 00000100:00100000:2.0:1788587059.435450:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:2.0:1788587059.435460:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:9695:x1875469181931392:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1788587059.435487:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587059.435511:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88c24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c272e expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.435626:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5600/0xc1a730b05ab88c2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.435655:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5600/0xc1a730b05ab88c2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.435667:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5600/0xc1a730b05ab88c2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587059.435681:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587059.435814:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c272e expref: 17 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.435834:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5600/0xc1a730b05ab88c2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c272e expref: 16 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.435892:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:2.0:1788587059.435895:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587059.435899:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5600, rc 0) 00000100:00100000:2.0:1788587059.435969:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:9695:x1875469181931392:12345-192.168.204.28@tcp:101:rm.0 Request processed in 510us (1326us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788587059.435977:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1788587059.444925:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.445018:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181931520 00000100:00100000:2.0:1788587059.445028:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181931520 00000100:00100000:2.0:1788587059.445239:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1788587059.445250:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:9695:x1875469181931520:12345-192.168.204.28@tcp:41:rm.0 00000004:00000024:2.0:1788587059.445324:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788587059.445435:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:9695:x1875469181931520:12345-192.168.204.28@tcp:41:rm.0 Request processed in 187us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587059.445443:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:1.0:1788587059.456481:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.457331:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181931648 00000100:00100000:2.0:1788587059.457345:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181931648 00000100:00100000:2.0:1788587059.457475:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:2.0:1788587059.457489:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:9695:x1875469181931648:12345-192.168.204.28@tcp:101:rm.0 00010000:00010000:2.0:1788587059.457519:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587059.457561:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88c39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2735 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457643:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457658:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457671:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457687:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457694:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457700:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457809:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457818:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457877:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587059.457908:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788587059.457911:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587059.457929:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457940:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457948:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457954:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457960:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457966:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587059.457970:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457978:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.457990:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:2.0:1788587059.457994:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587059.457998:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458015:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88c40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458028:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458034:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458039:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458044:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587059.458047:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458052:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458060:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff8baca0968400) 00010000:00010000:2.0:1788587059.458063:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587059.458065:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.458071:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.459061:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2735 expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.459088:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2735 expref: 17 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.459118:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8baca0968c00) 00010000:00010000:2.0:1788587059.459121:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587059.459124:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4a00, rc 0) 00000100:00100000:2.0:1788587059.459206:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:9695:x1875469181931648:12345-192.168.204.28@tcp:101:rm.0 Request processed in 1719us (2741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587059.459214:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1788587059.464041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587059.464377:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181931904 00000100:00100000:1.0:1788587059.464389:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181931904 00000100:00100000:1.0:1788587059.464459:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:1.0:1788587059.464470:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:9695:x1875469181931904:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:1.0:1788587059.464547:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788587059.464576:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2735 expref: 17 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464599:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88bfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2719 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464611:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8baca0968c00) 00010000:00010000:1.0:1788587059.464627:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2720 expref: 15 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464637:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:1.0:1788587059.464641:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587059.464664:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464678:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464688:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464704:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464712:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.464735:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.465199:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.465211:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.465220:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587059.466748:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788587059.466763:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381670919857ns, next at 382670916832ns, rc = 0 00010000:00010000:1.0:1788587059.466879:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.466894:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.466915:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.466923:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.466929:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.466935:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467230:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587059.467257:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467264:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467270:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467276:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587059.467281:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467289:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467301:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8baca1025100) 00010000:00010000:1.0:1788587059.467304:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788587059.467308:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467314:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88c63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467332:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467337:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467342:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467353:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587059.467355:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467362:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467370:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:1.0:1788587059.467373:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587059.467376:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587059.467381:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88c55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587059.467393:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ff178cb reply state 000000009a5b352c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587059.467401:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587059.467551:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:9695:x1875469181931904:12345-192.168.204.28@tcp:36:rm.0 Request processed in 3080us (3517us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788587059.467560:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00010000:00010000:3.0:1788587059.467772:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587059.467780:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.467786:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587059.467789:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.467796:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.467806:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8baca1025100) 00010000:00010000:3.0:1788587059.467809:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788587059.467811:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.467817:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88c6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.467833:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587059.467835:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587059.467837:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587059.470604:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.470621:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.470629:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.470635:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587059.470641:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.470649:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.470667:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff8baca1025c00) 00010000:00010000:2.0:1788587059.470670:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587059.470675:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.470681:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88c5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587059.473648:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587059.474349:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181932160 00000100:00100000:2.0:1788587059.474361:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181932160 00000100:00100000:2.0:1788587059.474426:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:2.0:1788587059.474437:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:9695:x1875469181932160:12345-192.168.204.28@tcp:35:rm.0 00000100:00100000:2.0:1788587059.474802:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:9695:x1875469181932160:12345-192.168.204.28@tcp:35:rm.0 Request processed in 366us (1162us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788587059.474810:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:1.0:1788587059.483433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587059.487634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181932416 00000100:00100000:0.0:1788587059.487656:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181932416 00000100:00100000:0.0:1788587059.488265:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:0.0:1788587059.488281:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:9695:x1875469181932416:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:0.0:1788587059.488344:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788587059.488373:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5600/0xc1a730b05ab88c2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c272e expref: 16 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.488396:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c270b expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.488409:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac987bc200) 00010000:00010000:0.0:1788587059.488424:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88b8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26fd expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.488432:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968b00) 00010000:00010000:0.0:1788587059.488455:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587059.488483:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.488499:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.488509:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.488521:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.490655:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.490670:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.492867:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.492890:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.492902:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587059.494347:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788587059.494376:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494386:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494402:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494408:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587059.494413:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494422:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494437:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8bac90439000) 00010000:00010000:0.0:1788587059.494441:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788587059.494446:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494453:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88c7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494480:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494486:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494493:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494498:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587059.494501:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.494517:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.496206:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac90439100) 00010000:00010000:0.0:1788587059.496215:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587059.496222:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587059.496231:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88c71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587059.496254:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b634d5ec reply state 000000004c22c63e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587059.496264:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587059.496485:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:9695:x1875469181932416:12345-192.168.204.28@tcp:36:rm.0 Request processed in 8205us (13059us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788587059.496493:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00010000:00010000:2.0:1788587059.500291:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.500309:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.500317:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.500324:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587059.500329:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.500337:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.500354:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8bac90439c00) 00010000:00010000:2.0:1788587059.500357:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587059.500363:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587059.500390:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88c78 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587059.908102:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587060.240047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587060.240463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181932544 00000100:00100000:3.0:1788587060.240474:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181932544 00000100:00100000:3.0:1788587060.240545:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 252 00000100:00100000:3.0:1788587060.240555:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181932544:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587060.240640:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181932544:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 86us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587060.240648:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 252 00000100:00100000:1.0:1788587060.242468:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587060.242525:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587060.242563:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587060.242599:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181932672 00000100:00100000:1.0:1788587060.242608:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181932672 00000100:00100000:1.0:1788587060.242668:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181932928 00000100:00100000:1.0:1788587060.242672:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181932928 00000100:00100000:1.0:1788587060.242701:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:1.0:1788587060.242711:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469181932672:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587060.242784:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469181932672:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587060.242791:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:1.0:1788587060.242807:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 108 00000100:00100000:1.0:1788587060.242814:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181932928:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587060.242837:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181932928:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587060.242865:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 108 00000100:00100000:3.0:1788587060.243259:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181932800 00000100:00100000:3.0:1788587060.243265:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181932800 00000100:00100000:3.0:1788587060.243308:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:3.0:1788587060.243317:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181932800:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587060.243354:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181932800:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 39us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587060.243361:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00080000:2.0:1788587060.243912:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587060.944106:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587061.956815:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587062.979643:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587063.299683:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208180352:0@lo:400:kworker.0 00000100:00100000:2.0:1788587063.299777:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788587063.300088:0:7144:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385504240969ns, next at 386504238734ns, rc = 0 00000100:00100000:3.0:1788587063.300124:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208180480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587063.300163:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587063.300222:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180480 00000100:00100000:3.0:1788587063.300233:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180480 00000100:00100000:1.0:1788587063.300306:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180352 00000100:00100000:3.0:1788587063.300308:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788587063.300322:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180352 00000100:00100000:3.0:1788587063.300330:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208180480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587063.300374:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587063.300397:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788587063.300411:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208180352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.300441:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208180480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587063.300451:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788587063.300706:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788587063.300739:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbf98d180 x1875469208180480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587063.300763:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208180480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587063.302972:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208180736:0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.303083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587063.303177:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208180608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.303206:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587063.303250:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180736 00000100:00100000:3.0:1788587063.303258:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180736 00000100:00100000:3.0:1788587063.303932:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180608 00000100:00100000:3.0:1788587063.303941:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180608 00000100:00100000:3.0:1788587063.303981:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788587063.303991:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208180736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.304065:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208180736:12345-0@lo:400:kworker.0 Request processed in 75us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587063.304072:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788587063.304091:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788587063.304098:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208180608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.304143:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208180608:12345-0@lo:400:kworker.0 Request processed in 46us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587063.304149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1788587063.304186:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587063.304218:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208180608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.304261:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208180736:0@lo:400:kworker.0 00000100:00100000:1.0:1788587063.306895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208180352:12345-0@lo:400:kworker.0 Request processed in 6469us (7099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587063.306916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788587063.307484:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208180992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587063.307568:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587063.307664:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587063.307678:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc1ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208180864:0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.307710:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587063.307741:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180864 00000100:00100000:0.0:1788587063.307741:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208180992 00000100:00100000:0.0:1788587063.307748:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180992 00000100:00100000:3.0:1788587063.307751:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208180864 00000100:00100000:0.0:1788587063.307813:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587063.307824:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208180992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.308564:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788587063.308573:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208180864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587063.308634:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208180864:12345-0@lo:400:kworker.0 Request processed in 63us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587063.308641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788587063.308693:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208180864:0@lo:400:kworker.0 00000100:00080000:3.0:1788587063.308809:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587063.308815:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587063.309982:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208180352:0@lo:400:kworker.0 00000100:00100000:0.0:1788587063.311800:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208180992:12345-0@lo:400:kworker.0 Request processed in 3958us (4211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587063.311814:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788587063.314205:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacc1ab0a80 x1875469208180992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587063.314225:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc1ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208180992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587063.812059:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208181120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587063.812539:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587063.812654:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208181120 00000100:00100000:1.0:1788587063.812666:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208181120 00000100:00100000:1.0:1788587063.812736:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788587063.812749:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208181120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587063.812799:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587063.813709:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208181120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 958us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587063.813720:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788587063.813800:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5b97100 x1875469208181120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587063.813830:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208181120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587064.003221:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587064.368715:0:11640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1788587064.378825:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788587064.378999:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:3.0:1788587064.379055:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788587064.384371:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587064.384402:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208181248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788587064.384496:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587064.384892:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208181248 00000100:00100000:3.0:1788587064.384905:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208181248 00000100:00100000:3.0:1788587064.384987:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788587064.384998:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208181248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788587064.385033:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788587064.385078:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9bac33, atime: 0x6a9bac33, ctime: 0x6a9bac33, blocks: 0x1 00010000:00010000:3.0:1788587064.385098:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587064.385118:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:3.0:1788587064.385130:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587064.385140:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587064.385161:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587064.385172:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587064.385181:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587064.385203:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587064.385906:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875469208181248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 904us (1404us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788587064.385917:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788587064.386387:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587064.386398:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587064.386412:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587064.386418:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587064.386429:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587064.386458:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587064.386467:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f08a273f/0xc1a730b05ab88c86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587064.386504:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587064.386506:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587064.386508:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788587064.386560:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bac83052680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788587064.386567:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208181248:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788587065.035223:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587065.369826:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587065.369901:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587065.369935:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587065.369965:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587065.371473:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933184 00000100:00100000:1.0:1788587065.371489:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933184 00000100:00100000:1.0:1788587065.371572:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933440 00000100:00100000:1.0:1788587065.371576:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933440 00000100:00100000:1.0:1788587065.371607:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 112 00000100:00100000:1.0:1788587065.371619:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181933184:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587065.371733:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181933184:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 117us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587065.371742:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 112 00000100:00100000:1.0:1788587065.371762:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:1.0:1788587065.371777:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181933440:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587065.372049:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181933440:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587065.372059:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:1.0:1788587065.372103:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933312 00000100:00100000:1.0:1788587065.372108:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933312 00000100:00100000:1.0:1788587065.372141:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1788587065.372148:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181933312:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587065.372355:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933056 00000100:00100000:0.0:1788587065.372361:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933056 00000100:00100000:0.0:1788587065.372412:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 254 00000100:00100000:0.0:1788587065.372421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181933056:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587065.372498:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181933312:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 350us (2597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587065.372507:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:0.0:1788587065.372736:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181933056:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 316us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587065.372743:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 254 00000100:00080000:0.0:1788587065.373203:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587065.373210:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788587065.904382:0:11690:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd150a25d0 20000000:00000080:3.0:1788587065.904415:0:11690:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bacbf8cf800 uarg=0000000000000000 20000000:01000000:3.0:1788587065.904474:0:11690:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788587065.904483:0:11690:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788587065.904490:0:11690:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788587065.910688:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788587065.912501:0:11690:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788587065.920360:0:11690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788587065.920456:0:11690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788587065.920528:0:11690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788587065.920553:0:11690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788587065.920583:0:11690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920610:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920619:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920628:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920634:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920658:0:11690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920667:0:11690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920727:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.920747:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 18 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587065.920765:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181376:0@lo:104: 00000100:00100000:1.0:1788587065.920883:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587065.921269:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.921280:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587065.921290:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181504:0@lo:104: 00000100:00100000:1.0:1788587065.921318:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788587065.921564:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.921573:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 18 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587065.921584:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b97480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181632:0@lo:104: 00000100:00100000:1.0:1788587065.921625:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587065.921683:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208181376 00000100:00100000:0.0:1788587065.921694:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208181376 00000100:00100000:0.0:1788587065.921747:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208181504 00000100:00100000:0.0:1788587065.921750:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208181504 00000100:00100000:0.0:1788587065.921768:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587065.921780:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:11690:x1875469208181376:12345-0@lo:104: 00010000:00010000:0.0:1788587065.921798:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587065.921903:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587065.921910:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+4:11690:x1875469208181376:12345-0@lo:104: Request processed in 132us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587065.921918:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788587065.921939:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587065.921945:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11690:x1875469208181504:12345-0@lo:104: 00010000:00010000:0.0:1788587065.921954:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587065.922142:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788587065.922148:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11690:x1875469208181504:12345-0@lo:104: Request processed in 204us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587065.922154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788587065.922293:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.922308:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 12 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587065.922320:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181760:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587065.922411:0:11690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.922421:0:11690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 12 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587065.922430:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181888:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587065.922461:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788587065.922495:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181376:0@lo:104: 00000100:00100000:1.0:1788587065.922504:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181504:0@lo:104: 00010000:00010000:3.0:1788587065.922718:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587065.922728:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.922738:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52aa00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587065.922750:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.922761:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587065.922769:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587065.922775:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587065.922814:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.922821:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587065.922871:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.922880:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf52aa00/0xc1a730b05ab88b52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b59 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.922898:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587065.922902:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.922909:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52bc00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587065.922911:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.922918:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587065.922936:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587065.922942:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587065.922959:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923193:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587065.923217:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923225:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf52bc00/0xc1a730b05ab88b44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b4b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923239:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587065.923240:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587065.923242:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587065.923260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208182016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587065.923314:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587065.923380:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208182144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587065.923408:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587065.923529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182016 00000100:00100000:3.0:1788587065.923536:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182016 00010000:00010000:3.0:1788587065.923569:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 19 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587065.923599:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182144 00000100:00100000:3.0:1788587065.923602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182144 00010000:00010000:3.0:1788587065.923614:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 20 pid: 5845 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587065.923645:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587065.923653:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+20:3313:x1875469208182016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587065.923668:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587065.923673:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 20 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923686:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 20 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923703:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a98c00/0xc1a730b05ab88b59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88b52 expref: 20 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923719:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587065.923753:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208182016:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587065.923760:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788587065.923778:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587065.923784:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3314:x1875469208182144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587065.923792:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587065.923797:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923804:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923814:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88b4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88b44 expref: 18 pid: 5845 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.923834:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587065.923894:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3314:x1875469208182144:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587065.923901:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587065.923946:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208182144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587065.923974:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208182016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587065.924229:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788587065.924247:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208181632 00000100:00100000:0.0:1788587065.924252:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208181632 00000100:00100000:0.0:1788587065.924280:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788587065.924288:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11690:x1875469208181632:12345-0@lo:104: 00010000:00010000:0.0:1788587065.924300:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587065.924354:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587065.924360:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+3:11690:x1875469208181632:12345-0@lo:104: Request processed in 74us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587065.924366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587065.924612:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b97480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181632:0@lo:104: 00010000:00010000:3.0:1788587065.924676:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587065.924683:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.924693:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587065.924697:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.924707:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587065.924715:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587065.924721:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587065.924804:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.924811:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587065.924881:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.924907:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88b36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab88b3d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.924925:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587065.924927:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587065.924929:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587065.924952:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587065.924977:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208182272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587065.925108:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587065.925162:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182272 00000100:00100000:3.0:1788587065.925168:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182272 00010000:00010000:3.0:1788587065.925194:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 17 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587065.925222:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587065.925231:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88343850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3314:x1875469208182272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587065.925245:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587065.925250:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 17 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.925265:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 17 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.925280:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a99400/0xc1a730b05ab88b3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab88b36 expref: 17 pid: 5842 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.925292:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587065.925323:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88343850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3314:x1875469208182272:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587065.925337:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587065.925402:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208182272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587065.925457:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587065.929898:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587065.930032:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587065.930080:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933696 00000100:00100000:3.0:1788587065.930095:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933696 00010000:00010000:3.0:1788587065.930164:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 13 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587065.930206:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933568 00000100:00100000:3.0:1788587065.930209:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933568 00010000:00010000:3.0:1788587065.930296:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 14 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587065.930322:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1788587065.930333:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+14:2361:x1875469181933696:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587065.930353:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587065.930359:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 14 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587065.930443:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:0.0:1788587065.930455:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+14:2361:x1875469181933568:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587065.930456:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 14 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587065.930465:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587065.930469:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 14 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587065.930481:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 14 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587065.930896:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181760:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587065.930925:0:11690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c5600/0xc1a730b05ab88b28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26e8 expref: 14 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587065.930941:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11690:1875469208181888:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587065.934725:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587065.934889:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181933696:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4546us (5033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587065.934914:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00010000:00010000:0.0:1788587065.936518:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4e00/0xc1a730b05ab88b2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26ef expref: 12 pid: 5842 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587065.936551:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587065.936563:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936702:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936712:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936721:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936728:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936741:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ba00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587065.936747:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936757:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936769:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587065.936783:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587065.936895:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:2361:x1875469181933568:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6442us (6862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587065.936907:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00010000:00010000:2.0:1788587065.938423:0:11690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.938522:0:11690:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.938532:0:11690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587065.938540:0:11690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf52ba00/0xc1a730b05ab88c8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587066.055715:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587067.075428:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788587067.780128:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788587067.780137:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacbb896000 from 7 10000000:01000000:1.0:1788587067.780143:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788587067.780201:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587067.780212:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587067.780224:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587067.780254:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208182400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788587067.780332:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587067.780691:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587067.781741:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182400 00000100:00100000:0.0:1788587067.781761:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182400 00000100:00100000:0.0:1788587067.781965:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788587067.781979:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:5847:x1875469208182400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587067.782005:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587067.782052:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a98400/0xc1a730b05ab88c9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88c94 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587067.782570:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a98400/0xc1a730b05ab88c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88c94 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587067.782587:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a98400/0xc1a730b05ab88c9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88c94 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587067.782599:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98400, rc 0) 00000100:00100000:0.0:1788587067.782715:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208182400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 738us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587067.782722:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788587067.782917:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208182400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587067.782948:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587067.782962:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587067.783067:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208182528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587067.783124:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.788286:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182528 00000100:00100000:1.0:1788587067.788300:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.788311:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182528 00000100:00100000:3.0:1788587067.788393:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788587067.788408:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208182528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.789232:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208182528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 824us (6104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.789307:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788587067.789646:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208182528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587067.789724:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208182656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587067.789805:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587067.789888:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.791622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182656 00000100:00100000:3.0:1788587067.791635:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182656 00000100:00100000:3.0:1788587067.791703:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788587067.791715:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208182656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.792006:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208182656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 293us (2200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.792016:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788587067.795231:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208182656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587067.795978:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11703:1875469208182784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587067.796092:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587067.796139:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788587067.796809:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182784 00000100:00100000:2.0:1788587067.796819:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182784 00000100:00100000:2.0:1788587067.796913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788587067.796924:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:11703:x1875469208182784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587067.797199:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:11703:x1875469208182784:12345-0@lo:502:llog_process_th.0 Request processed in 277us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587067.797206:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788587067.799036:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11703:1875469208182784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587067.799096:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587067.799109:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587067.799111:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587067.799119:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bacbb896000 00000020:00000080:1.0:1788587067.799122:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788587067.799227:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11703:1875469208182912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587067.799314:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587067.799362:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.800359:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208182912 00000100:00100000:3.0:1788587067.800384:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208182912 00000100:00100000:3.0:1788587067.800442:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788587067.800452:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:11703:x1875469208182912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587067.800764:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:11703:x1875469208182912:12345-0@lo:502:llog_process_th.0 Request processed in 313us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.800772:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788587067.802161:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11703:1875469208182912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587067.802211:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587067.802220:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587067.802223:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788587067.802228:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788587067.803667:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788587067.803691:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587067.803704:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587067.803727:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587067.803738:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587067.803741:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacaf3ef800 from 7 10000000:01000000:2.0:1788587067.803744:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587067.803781:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587067.803788:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587067.803799:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587067.803824:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587067.803932:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587067.803978:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab81afdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587067.804418:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183040 00000100:00100000:1.0:1788587067.804431:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183040 00000100:00100000:1.0:1788587067.804600:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788587067.804610:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:5847:x1875469208183040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587067.804626:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587067.804640:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf52ae00/0xc1a730b05ab88ca9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88ca2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587067.804666:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf52ae00/0xc1a730b05ab88ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88ca2 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587067.804676:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf52ae00/0xc1a730b05ab88ca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88ca2 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587067.804685:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52ae00, rc 0) 00000100:00100000:1.0:1788587067.804740:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208183040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587067.804747:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788587067.804930:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587067.804946:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587067.804955:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587067.805009:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587067.805052:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587067.805359:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183168 00000100:00100000:1.0:1788587067.805364:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183168 00000100:00100000:1.0:1788587067.805885:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788587067.805894:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208183168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587067.806220:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208183168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587067.806228:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788587067.806352:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab81afdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587067.806385:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587067.806431:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587067.806488:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587067.806512:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab81afdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.806623:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183296 00000100:00100000:3.0:1788587067.806629:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183296 00000100:00100000:3.0:1788587067.806656:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788587067.806664:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208183296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.806808:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208183296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.806814:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788587067.807197:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587067.807990:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11704:1875469208183424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587067.808046:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587067.808113:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab81afde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.809119:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183424 00000100:00100000:3.0:1788587067.809129:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183424 00000100:00100000:3.0:1788587067.809214:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788587067.809223:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:11704:x1875469208183424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587067.809445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:11704:x1875469208183424:12345-0@lo:502:llog_process_th.0 Request processed in 223us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.809452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788587067.809550:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11704:1875469208183424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788587067.809597:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587067.809608:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587067.809610:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788587067.809618:0:11704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bacaf3ef800 00000020:00000080:2.0:1788587067.809621:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788587067.809704:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11704:1875469208183552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587067.809743:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.810255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183552 00000100:00100000:3.0:1788587067.810261:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183552 00000100:00100000:3.0:1788587067.810284:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788587067.810292:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:11704:x1875469208183552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587067.810448:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:11704:x1875469208183552:12345-0@lo:502:llog_process_th.0 Request processed in 155us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.810572:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788587067.810637:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab81afde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.810654:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11704:1875469208183552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587067.810684:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587067.810691:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587067.810694:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788587067.810699:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788587067.810771:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788587067.810789:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587067.810800:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.810811:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587067.810821:0:5847:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788587067.810825:0:5847:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac83941800 from 7 10000000:01000000:3.0:1788587067.810828:0:5847:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788587067.810874:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.810882:0:5847:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.810891:0:5847:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587067.810906:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.810937:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.810952:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.810964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183680 00000100:00100000:3.0:1788587067.810967:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183680 00000100:00100000:3.0:1788587067.810985:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788587067.810997:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:5847:x1875469208183680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587067.811008:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587067.811034:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88cb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab88cb0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.811060:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab88cb0 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.811070:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88cb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab88cb0 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.811081:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4000, rc 0) 00000100:00100000:3.0:1788587067.811108:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208183680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.811115:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788587067.811143:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587067.811156:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.811165:0:5847:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587067.811208:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.811231:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.811242:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac87c86780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.811253:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183808 00000100:00100000:3.0:1788587067.811255:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183808 00000100:00100000:3.0:1788587067.811272:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788587067.811284:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208183808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.811952:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208183808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 665us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.811961:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788587067.811999:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.812041:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.812084:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.812099:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac87c86780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.812113:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208183936 00000100:00100000:3.0:1788587067.812117:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208183936 00000100:00100000:3.0:1788587067.812138:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788587067.812144:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208183936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.812286:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:5847:x1875469208183936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.812294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788587067.812331:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:5847:1875469208183936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587067.813060:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11707:1875469208184064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587067.813105:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.813133:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184064 00000100:00100000:3.0:1788587067.813138:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184064 00000100:00100000:3.0:1788587067.813163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788587067.813171:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:11707:x1875469208184064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587067.813320:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:11707:x1875469208184064:12345-0@lo:502:llog_process_th.0 Request processed in 149us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.813336:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788587067.813369:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.813383:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11707:1875469208184064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587067.813411:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587067.813422:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587067.813424:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587067.813433:0:11707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bac83941800 00000020:00000080:3.0:1788587067.813435:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587067.813508:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11707:1875469208184192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587067.813553:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587067.813572:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184192 00000100:00100000:3.0:1788587067.813575:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184192 00000100:00100000:3.0:1788587067.813591:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788587067.813595:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:11707:x1875469208184192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587067.813694:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9025b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:11707:x1875469208184192:12345-0@lo:502:llog_process_th.0 Request processed in 96us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.813701:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788587067.813727:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c78480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587067.813739:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:11707:1875469208184192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587067.813755:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587067.813759:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587067.813760:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788587067.813763:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788587067.813805:0:5847:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788587067.813820:0:5847:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587067.813829:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.813868:0:5847:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587067.826968:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587067.918443:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587067.918513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933824 00000100:00100000:3.0:1788587067.918530:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933824 00000100:00100000:3.0:1788587067.918597:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 270 00000100:00100000:3.0:1788587067.918610:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:5605:x1875469181933824:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587067.918630:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587067.918650:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bac829c4600/0xc1a730b05ab88cbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c273c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.918685:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bac829c4600/0xc1a730b05ab88cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c273c expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.918697:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bac829c4600/0xc1a730b05ab88cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c273c expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587067.918706:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4600, rc 0) 00000100:00100000:3.0:1788587067.918767:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181933824:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.918773:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 270 00000100:00100000:3.0:1788587067.931694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587067.936908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181933952 00000100:00100000:2.0:1788587067.936927:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181933952 00000100:00100000:2.0:1788587067.936998:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 271 00000100:00100000:2.0:1788587067.937010:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181933952:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587067.938038:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181933952:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 1012us (6336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587067.938049:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 271 00000100:00100000:1.0:1788587067.950840:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587067.951039:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934080 00000100:00100000:0.0:1788587067.951049:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934080 00000100:00100000:0.0:1788587067.951107:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 272 00000100:00100000:0.0:1788587067.951118:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181934080:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587067.951364:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181934080:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 247us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587067.951379:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 272 00000100:00100000:1.0:1788587067.973038:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587067.973543:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934208 00000100:00100000:0.0:1788587067.973556:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934208 00000100:00100000:0.0:1788587067.973718:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 273 00000100:00100000:0.0:1788587067.973728:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:9966:x1875469181934208:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587067.974031:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:9966:x1875469181934208:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 290us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587067.974040:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 273 00000100:00100000:2.0:1788587067.985344:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587067.985893:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934336 00000100:00100000:3.0:1788587067.985906:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934336 00000100:00100000:3.0:1788587067.985993:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 274 00000100:00100000:3.0:1788587067.986003:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:9966:x1875469181934336:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587067.987753:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:9966:x1875469181934336:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 1744us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587067.987766:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 274 00000100:00100000:2.0:1788587067.998992:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587068.000266:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934464 00000100:00100000:1.0:1788587068.000279:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934464 00000100:00100000:1.0:1788587068.000349:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 275 00000100:00100000:1.0:1788587068.000362:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:5605:x1875469181934464:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587068.000384:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587068.000411:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf52ac00/0xc1a730b05ab88cc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2743 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587068.000442:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf52ac00/0xc1a730b05ab88cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2743 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587068.000454:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf52ac00/0xc1a730b05ab88cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2743 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587068.000462:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52ac00, rc 0) 00000100:00100000:1.0:1788587068.000548:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181934464:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 185us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587068.000556:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 275 00000100:00100000:1.0:1788587068.003491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587068.005424:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934592 00000100:00100000:3.0:1788587068.005448:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934592 00000100:00100000:2.0:1788587068.005951:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 276 00000100:00100000:2.0:1788587068.005984:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181934592:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587068.006747:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181934592:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 764us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587068.006757:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 276 00000100:00100000:2.0:1788587068.012772:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587068.013106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934720 00000100:00100000:0.0:1788587068.013119:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934720 00000100:00100000:0.0:1788587068.013219:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 277 00000100:00100000:0.0:1788587068.013239:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181934720:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587068.013485:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:5605:x1875469181934720:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 256us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587068.013494:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 277 00000100:00100000:1.0:1788587068.019946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587068.021734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934848 00000100:00100000:2.0:1788587068.021751:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934848 00000100:00100000:2.0:1788587068.021830:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 278 00000100:00100000:2.0:1788587068.021878:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:9969:x1875469181934848:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587068.022191:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:9969:x1875469181934848:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 351us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587068.022199:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 278 00000100:00100000:3.0:1788587068.035011:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587068.035257:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181934976 00000100:00100000:2.0:1788587068.035271:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181934976 00000100:00100000:2.0:1788587068.035332:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 279 00000100:00100000:2.0:1788587068.035343:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:9969:x1875469181934976:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587068.035735:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:9969:x1875469181934976:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 391us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587068.035744:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 279 00010000:00010000:0.0:1788587068.101623:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587068.419344:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208184320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587068.419442:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587068.419527:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208184832:0@lo:400:kworker.0 00000100:00100000:1.0:1788587068.419541:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208184704:0@lo:400:kworker.0 00000100:00100000:0.0:1788587068.419556:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587068.419579:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587068.419585:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208184448:0@lo:400:kworker.0 00000100:00100000:1.0:1788587068.419589:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587068.419607:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587068.419615:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587068.419620:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208184576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587068.419643:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587068.419651:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184704 00000100:00100000:1.0:1788587068.419667:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184448 00000100:00100000:0.0:1788587068.419667:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184704 00000100:00100000:1.0:1788587068.419669:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184448 00000100:00100000:3.0:1788587068.419785:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184320 00000100:00100000:3.0:1788587068.419791:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184320 00000100:00100000:3.0:1788587068.423647:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788587068.423667:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208184320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587068.423715:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587068.423809:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208184320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587068.423831:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788587068.423895:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184832 00000100:00100000:3.0:1788587068.423903:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184832 00000100:00100000:3.0:1788587068.423942:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788587068.423949:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208184832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587068.423986:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208184832:12345-0@lo:400:kworker.0 Request processed in 38us (4429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587068.423992:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788587068.424055:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacc18e7100 x1875469208184832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587068.424070:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208184832:0@lo:400:kworker.0 00000100:00100000:3.0:1788587068.424092:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208184320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587068.424373:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184576 00000100:00100000:2.0:1788587068.424379:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184576 00000100:00100000:1.0:1788587068.424622:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788587068.424630:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208184448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587068.424679:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208184448:12345-0@lo:400:kworker.0 Request processed in 50us (5071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587068.424686:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1788587068.424714:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587068.424718:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587068.424721:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587068.425375:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788587068.425393:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208184704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587068.425464:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208184704:12345-0@lo:400:kworker.0 Request processed in 80us (5873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587068.425470:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788587068.425517:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208184704:0@lo:400:kworker.0 00000100:00100000:2.0:1788587068.429432:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788587068.429451:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208184576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587068.429560:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208184576:12345-0@lo:400:kworker.0 Request processed in 113us (9915us total) trans 0 rc 0/0 00000100:00080000:1.0:1788587068.429569:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587068.429585:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788587068.429632:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208184576:0@lo:400:kworker.0 00000100:00100000:3.0:1788587068.430515:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208184448:0@lo:400:kworker.0 00000040:00080000:2.0:1788587068.867648:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788587068.931392:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208184960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587068.931476:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587068.932134:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208184960 00000100:00100000:1.0:1788587068.932145:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208184960 00000100:00100000:1.0:1788587068.932219:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587068.932230:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208184960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587068.932274:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1788587068.932749:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacc18e6d80 x1875469208184960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587068.932772:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208184960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587068.934335:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208184960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 282us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587068.934356:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1788587069.123150:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788587069.557238:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788587070.154036:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587070.476411:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587070.476452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587070.476489:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587070.476535:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181935232 00000100:00100000:3.0:1788587070.476541:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587070.476550:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181935232 00000100:00100000:3.0:1788587070.476573:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181935360 00000100:00100000:3.0:1788587070.476580:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181935360 00000100:00100000:1.0:1788587070.476626:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181935488 00000100:00100000:3.0:1788587070.476635:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:3.0:1788587070.476647:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181935360:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587070.476650:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181935488 00000100:00100000:1.0:1788587070.476682:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:1.0:1788587070.476690:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181935232:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587070.476780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181935104 00000100:00100000:2.0:1788587070.476784:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181935104 00000100:00100000:0.0:1788587070.476798:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:0.0:1788587070.476812:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181935488:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587070.476820:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 280 00000100:00100000:2.0:1788587070.476831:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181935104:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587070.476920:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181935360:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 274us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587070.476928:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:1.0:1788587070.484543:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181935232:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 7831us (8124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587070.484553:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181935488:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 7742us (8096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587070.484566:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:0.0:1788587070.484574:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00080000:1.0:1788587070.484635:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587070.484644:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587070.484721:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181935104:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 7890us (8228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587070.484733:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 280 00010000:00010000:3.0:1788587071.171112:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587072.195161:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587073.219071:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587073.539345:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208185216:0@lo:400:kworker.0 00000100:00100000:1.0:1788587073.539425:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587073.539501:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208185728:0@lo:400:kworker.0 00000100:00100000:1.0:1788587073.539527:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587073.539557:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788587073.539563:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208185088:0@lo:400:kworker.0 00000100:00100000:1.0:1788587073.539589:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587073.539621:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208185600:0@lo:400:kworker.0 00000100:00100000:1.0:1788587073.539644:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587073.539686:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185728 00000100:00100000:1.0:1788587073.539692:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185216 00000100:00100000:3.0:1788587073.539696:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185728 00000100:00100000:1.0:1788587073.539698:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185216 00000100:00100000:1.0:1788587073.539744:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185600 00000100:00100000:1.0:1788587073.539748:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185600 00000100:00100000:3.0:1788587073.539754:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587073.539765:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208185728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587073.539774:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788587073.539783:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208185216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587073.539830:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208185728:12345-0@lo:400:kworker.0 Request processed in 66us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587073.539832:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208185216:12345-0@lo:400:kworker.0 Request processed in 50us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587073.539866:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788587073.539874:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788587073.539902:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788587073.539921:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208185600:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788587073.539956:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587073.539957:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208185600:12345-0@lo:400:kworker.0 Request processed in 48us (313us total) trans 0 rc 0/0 00000100:00080000:3.0:1788587073.539963:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587073.539967:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788587073.540009:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208185600:0@lo:400:kworker.0 00000100:00100000:1.0:1788587073.540020:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208185216:0@lo:400:kworker.0 00010000:00080000:1.0:1788587073.540031:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5945500 x1875469208185728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587073.540041:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5945500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208185728:0@lo:400:kworker.0 00000100:00100000:2.0:1788587073.540187:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185088 00000100:00100000:2.0:1788587073.540192:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185088 00000100:00100000:2.0:1788587073.540233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788587073.540241:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208185088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587073.540288:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208185088:12345-0@lo:400:kworker.0 Request processed in 48us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587073.540294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788587073.541930:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208185088:0@lo:400:kworker.0 00000100:00100000:0.0:1788587073.543377:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208185344:0@lo:400:kworker.0 00000100:00100000:0.0:1788587073.543485:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587073.543547:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208185856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587073.543579:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587073.543619:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587073.543624:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208185472:0@lo:400:kworker.0 00000100:00100000:0.0:1788587073.543650:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587073.543739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185344 00000100:00100000:0.0:1788587073.543747:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185344 00000100:00100000:0.0:1788587073.543806:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788587073.543815:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208185344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587073.543979:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185472 00000100:00100000:3.0:1788587073.543984:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185472 00000100:00100000:3.0:1788587073.544024:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587073.544033:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208185344:12345-0@lo:400:kworker.0 Request processed in 217us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587073.544045:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208185472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587073.544045:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788587073.544107:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208185472:12345-0@lo:400:kworker.0 Request processed in 49us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587073.544116:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587073.544128:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788587073.544135:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bac83052680, transno 4294967300 00000100:00100000:0.0:1788587073.544147:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208185472:0@lo:400:kworker.0 00000100:00100000:0.0:1788587073.544161:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208185344:0@lo:400:kworker.0 00000100:00100000:2.0:1788587073.544248:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185856 00000100:00100000:2.0:1788587073.544252:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185856 00000100:00080000:3.0:1788587073.544283:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587073.544289:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587073.545045:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587073.545058:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208185856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587073.545183:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587073.545246:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208185856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587073.545254:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788587073.545394:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208185856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587074.052817:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587074.052865:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208185984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587074.052968:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587074.053041:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208185984 00000100:00100000:0.0:1788587074.053048:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208185984 00000100:00100000:0.0:1788587074.053097:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788587074.053107:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208185984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587074.053171:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587074.053218:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208185984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587074.053225:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788587074.053266:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbfadf100 x1875469208185984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587074.053285:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208185984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587074.243146:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587075.267093:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587075.596261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587075.596320:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587075.596353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587075.596387:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587075.596436:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181935744 00000100:00100000:1.0:1788587075.596451:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936000 00000100:00100000:0.0:1788587075.596457:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181935744 00000100:00100000:1.0:1788587075.596465:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936000 00000100:00100000:3.0:1788587075.596898:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181935872 00000100:00100000:3.0:1788587075.596906:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181935872 00000100:00100000:3.0:1788587075.596971:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:3.0:1788587075.596983:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181935872:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587075.597096:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181935872:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 115us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587075.597104:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00080000:3.0:1788587075.597132:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587075.597138:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587075.600468:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:0.0:1788587075.600498:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181936000:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587075.600506:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181935616 00000100:00100000:2.0:1788587075.600524:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181935616 00000100:00100000:2.0:1788587075.600606:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 282 00000100:00100000:2.0:1788587075.600620:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181935616:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587075.600909:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87382050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181935616:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 291us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587075.600995:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181936000:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 150us (4245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587075.601005:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:2.0:1788587075.601016:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 282 00000100:00100000:0.0:1788587075.601041:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:0.0:1788587075.601055:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181935744:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587075.601111:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181935744:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 60us (4756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587075.601118:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 123 00010000:00010000:0.0:1788587076.291183:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587077.315081:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587078.084493:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587078.341283:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587078.660811:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587078.660873:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208186240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587078.660884:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208186880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587078.660963:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208186496:0@lo:400:kworker.0 00000100:00100000:1.0:1788587078.661023:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208186112:0@lo:400:kworker.0 00000100:00100000:0.0:1788587078.661196:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587078.661286:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208186880 00000100:00100000:0.0:1788587078.661295:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208186880 00000100:00100000:0.0:1788587078.661355:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788587078.661364:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208186880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587078.661420:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208186880:12345-0@lo:400:kworker.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587078.661428:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788587078.661465:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5b94a80 x1875469208186880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587078.661479:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208186880:0@lo:400:kworker.0 00000100:00080000:0.0:1788587078.661506:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587078.663324:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587078.663378:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208186752:0@lo:400:kworker.0 00000100:00100000:2.0:1788587078.663419:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587078.663666:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208186240 00000100:00100000:0.0:1788587078.663674:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208186240 00000100:00100000:0.0:1788587078.663738:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587078.663748:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208186240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587078.663788:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587078.663871:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208186240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587078.663879:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788587078.663905:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208186752 00000100:00100000:0.0:1788587078.663909:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208186752 00000100:00100000:0.0:1788587078.663941:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788587078.663949:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208186752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587078.663982:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208186752:12345-0@lo:400:kworker.0 Request processed in 34us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587078.663989:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788587078.664299:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587078.664305:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587078.664348:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208186240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587078.664360:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208186752:0@lo:400:kworker.0 00000100:00100000:3.0:1788587078.664884:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587078.664936:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208186368:0@lo:400:kworker.0 00000100:00100000:3.0:1788587078.664962:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587078.665114:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208186496 00000100:00100000:2.0:1788587078.665120:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208186496 00000100:00100000:2.0:1788587078.665207:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208186368 00000100:00100000:2.0:1788587078.665212:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208186368 00000100:00100000:2.0:1788587078.665232:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788587078.665240:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208186496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587078.665305:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208186496:12345-0@lo:400:kworker.0 Request processed in 65us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587078.665312:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788587078.665327:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788587078.665333:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208186368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587078.665361:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208186368:12345-0@lo:400:kworker.0 Request processed in 29us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587078.665500:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788587078.665558:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208186496:0@lo:400:kworker.0 00000100:00100000:2.0:1788587078.665587:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208186368:0@lo:400:kworker.0 00000100:00080000:3.0:1788587078.665667:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587078.665788:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587078.665857:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208186624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587078.665886:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587078.665964:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208186112 00000100:00100000:3.0:1788587078.665970:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208186112 00000100:00100000:3.0:1788587078.666008:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788587078.666015:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208186112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587078.666062:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87383050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208186112:12345-0@lo:400:kworker.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587078.666068:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788587078.666142:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208186112:0@lo:400:kworker.0 00000100:00100000:0.0:1788587078.666231:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208186624 00000100:00100000:0.0:1788587078.666242:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208186624 00000100:00100000:0.0:1788587078.666378:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587078.666386:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208186624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587078.666434:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208186624:12345-0@lo:400:kworker.0 Request processed in 49us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587078.666440:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788587078.666499:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208186624:0@lo:400:kworker.0 00000100:00100000:0.0:1788587079.171198:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587079.171237:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208187008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587079.171349:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587079.171567:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187008 00000100:00100000:1.0:1788587079.171585:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187008 00000100:00100000:1.0:1788587079.171654:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788587079.171666:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208187008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587079.171714:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587079.171829:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208187008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587079.171837:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788587079.171926:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5b94a80 x1875469208187008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587079.171950:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208187008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587079.363279:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587080.387335:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587080.719883:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587080.719931:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587080.720012:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936256 00000100:00100000:3.0:1788587080.720023:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936256 00000100:00100000:3.0:1788587080.720110:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:3.0:1788587080.720120:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181936256:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587080.720205:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181936256:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587080.720213:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:2.0:1788587080.720585:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936128 00000100:00100000:2.0:1788587080.720591:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936128 00000100:00100000:2.0:1788587080.720625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 284 00000100:00100000:2.0:1788587080.720631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181936128:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587080.720667:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469181936128:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 36us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587080.720673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 284 00000100:00080000:0.0:1788587080.720764:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587080.738673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587080.738723:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587080.739069:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936384 00000100:00100000:0.0:1788587080.739080:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936384 00000100:00100000:0.0:1788587080.739174:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:0.0:1788587080.739187:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2358:x1875469181936384:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:0.0:1788587080.739221:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88c01 00000100:00080000:0.0:1788587080.739231:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bacb48b7800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788587080.739433:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1788587080.739515:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788587080.739828:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+2:2358:x1875469181936384:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 642us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587080.739838:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00010000:00010000:3.0:1788587080.739936:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587080.740453:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936512 00000100:00100000:2.0:1788587080.740462:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936512 00000100:00100000:2.0:1788587080.740533:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:2.0:1788587080.740542:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181936512:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587080.740609:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2362:x1875469181936512:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 68us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587080.740616:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00080000:3.0:1788587080.740886:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587081.411086:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587082.435148:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587083.459285:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587083.779546:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208187392:0@lo:400:kworker.0 00000100:00100000:2.0:1788587083.779564:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208187264:0@lo:400:kworker.0 00000100:00100000:0.0:1788587083.779692:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208187520:0@lo:400:kworker.0 00000100:00100000:1.0:1788587083.779786:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208187136:0@lo:400:kworker.0 00000100:00100000:2.0:1788587083.791675:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587083.791790:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208187776:0@lo:400:kworker.0 00000100:00100000:3.0:1788587083.792132:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587083.792215:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208187904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587083.792261:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587083.792527:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587083.792642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587083.792684:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187904 00000100:00100000:2.0:1788587083.792695:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187904 00000100:00100000:0.0:1788587083.793092:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587083.793143:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187776 00000100:00100000:0.0:1788587083.793147:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187776 00000100:00100000:2.0:1788587083.798323:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587083.798344:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208187904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587083.798395:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587083.798515:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208187904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (6251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587083.798523:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788587083.798559:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187264 00000100:00100000:2.0:1788587083.798567:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187264 00000100:00100000:2.0:1788587083.798597:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187392 00000100:00100000:2.0:1788587083.798600:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187392 00000100:00100000:1.0:1788587083.798876:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587083.798922:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208187648:0@lo:400:kworker.0 00000100:00100000:1.0:1788587083.798955:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587083.799034:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936640 00000100:00100000:1.0:1788587083.799039:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936640 00000100:00100000:1.0:1788587083.799068:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187136 00000100:00100000:1.0:1788587083.799071:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187136 00000100:00100000:1.0:1788587083.799087:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 285 00000100:00100000:1.0:1788587083.799094:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181936640:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587083.799162:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac87381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181936640:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 67us (6525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587083.799169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 285 00000100:00100000:1.0:1788587083.799190:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788587083.799196:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208187136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587083.799229:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208187136:12345-0@lo:400:kworker.0 Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587083.799234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788587083.799261:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187648 00000100:00100000:1.0:1788587083.799264:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187648 00000100:00100000:0.0:1788587083.800491:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208187520 00000100:00100000:0.0:1788587083.800515:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208187520 00000100:00100000:0.0:1788587083.800548:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587083.800556:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208187776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587083.800637:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208187776:12345-0@lo:400:kworker.0 Request processed in 81us (8116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587083.800643:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587083.800659:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788587083.800665:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208187520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587083.800700:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208187520:12345-0@lo:400:kworker.0 Request processed in 36us (7610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587083.800706:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788587083.800780:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208187520:0@lo:400:kworker.0 00000100:00080000:3.0:1788587083.804901:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587083.804917:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587083.804921:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587083.809974:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788587083.809993:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208187264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587083.810100:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208187264:12345-0@lo:400:kworker.0 Request processed in 114us (18437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587083.810108:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788587083.810560:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587083.810586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587083.811081:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936768 00000100:00100000:1.0:1788587083.811088:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936768 00000100:00100000:1.0:1788587083.811115:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181936896 00000100:00100000:1.0:1788587083.811118:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181936896 00000100:00100000:1.0:1788587083.811131:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788587083.811138:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208187392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587083.811190:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208187392:12345-0@lo:400:kworker.0 Request processed in 53us (19065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587083.811196:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788587083.811212:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788587083.811218:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208187648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587083.811247:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208187648:12345-0@lo:400:kworker.0 Request processed in 30us (12292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587083.811252:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788587083.811265:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 132 00000100:00100000:1.0:1788587083.811270:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181936768:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587083.811320:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469181936768:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 50us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587083.811326:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 132 00000100:00100000:1.0:1788587083.811337:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:1.0:1788587083.811342:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181936896:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587083.811359:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181936896:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 17us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587083.811365:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:1.0:1788587083.811440:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208187904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587083.811453:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208187392:0@lo:400:kworker.0 00000100:00100000:1.0:1788587083.811500:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208187264:0@lo:400:kworker.0 00010000:00080000:1.0:1788587083.811515:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcca300 x1875469208187776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587083.811525:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208187776:0@lo:400:kworker.0 00000100:00080000:1.0:1788587083.811548:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587083.811737:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208187136:0@lo:400:kworker.0 00000100:00100000:0.0:1788587083.811888:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208187648:0@lo:400:kworker.0 00000100:00100000:2.0:1788587084.292714:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587084.292750:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208188032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587084.292889:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587084.294347:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188032 00000100:00100000:0.0:1788587084.294367:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188032 00000100:00100000:0.0:1788587084.294456:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587084.294594:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208188032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587084.294968:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587084.295097:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208188032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 630us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587084.295106:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788587084.296039:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbbcc8380 x1875469208188032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587084.296071:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208188032:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587084.483745:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788587084.915758:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:0.0:1788587084.915791:0:6730:0:(genops.c:885:class_export_put()) final put ffff8bacb48b6800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:1.0:1788587084.916106:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacb48b6800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 for lustre-OST0000 00000020:00000080:1.0:1788587084.916185:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacb48b7800 for lustre-OST0000 00010000:00010000:0.0:1788587085.507416:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587085.840957:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587085.841013:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587085.841085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587085.841288:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937152 00000100:00100000:0.0:1788587085.841301:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937152 00000100:00100000:0.0:1788587085.841389:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937280 00000100:00100000:0.0:1788587085.841394:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937280 00000100:00100000:0.0:1788587085.841419:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 134 00000100:00100000:0.0:1788587085.841430:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2361:x1875469181937152:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587085.841557:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2361:x1875469181937152:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 128us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587085.841566:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 134 00000100:00100000:0.0:1788587085.841588:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:0.0:1788587085.841595:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181937280:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587085.841621:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181937280:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 27us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587085.841628:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:1.0:1788587085.842116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937024 00000100:00100000:1.0:1788587085.842125:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937024 00000100:00100000:1.0:1788587085.842177:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 287 00000100:00100000:1.0:1788587085.842185:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181937024:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587085.842226:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181937024:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 42us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587085.842251:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 287 00000100:00080000:3.0:1788587085.843574:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587086.531080:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587087.557596:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587088.326607:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587088.580394:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587088.901330:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208188416:0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.901340:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208188160:0@lo:400:kworker.0 00000100:00100000:0.0:1788587088.904437:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208188288:0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.906583:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587088.906670:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208188672:0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.906722:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587088.906781:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188672 00000100:00100000:1.0:1788587088.906791:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188672 00000100:00100000:1.0:1788587088.906893:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788587088.906905:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208188672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.906960:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208188672:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.906967:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788587088.907012:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208188544:0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.907046:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587088.907075:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587088.907081:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208188928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587088.907104:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587088.907129:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587088.907144:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188544 00000100:00100000:1.0:1788587088.907148:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188544 00000100:00100000:1.0:1788587088.907179:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587088.907186:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208188544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.907220:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208188544:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.907238:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587088.907257:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188928 00000100:00100000:1.0:1788587088.907261:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188928 00000100:00100000:1.0:1788587088.907283:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788587088.907289:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208188928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587088.907319:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587088.907352:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208188928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.907358:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788587088.907371:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587088.908145:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208188928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587088.908159:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208188544:0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.908224:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208188672:0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.912334:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188160 00000100:00100000:1.0:1788587088.912352:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188160 00000100:00100000:1.0:1788587088.912444:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788587088.912456:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208188160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587088.912556:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208188160:12345-0@lo:400:kworker.0 Request processed in 101us (5982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587088.912577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788587088.912749:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208188160:0@lo:400:kworker.0 00000100:00100000:2.0:1788587088.913829:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587088.914840:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188416 00000100:00100000:3.0:1788587088.914872:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188416 00000100:00080000:2.0:1788587088.914966:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587088.914975:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788587088.914988:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208188416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587088.915352:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208188416:12345-0@lo:400:kworker.0 Request processed in 366us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.915361:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788587088.916275:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208188416:0@lo:400:kworker.0 00000100:00100000:0.0:1788587088.917286:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587088.917402:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208188800:0@lo:400:kworker.0 00000100:00100000:0.0:1788587088.917450:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587088.917658:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188800 00000100:00100000:3.0:1788587088.917667:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188800 00000100:00100000:3.0:1788587088.917815:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788587088.917826:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208188800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587088.917924:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208188800:12345-0@lo:400:kworker.0 Request processed in 99us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587088.917931:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788587088.917976:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5b94700 x1875469208188800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587088.917991:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208188800:0@lo:400:kworker.0 00000100:00080000:2.0:1788587088.921513:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587088.930432:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208188288 00000100:00100000:1.0:1788587088.930452:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208188288 00000100:00100000:2.0:1788587088.931243:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788587088.931255:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208188288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587088.931388:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208188288:12345-0@lo:400:kworker.0 Request processed in 136us (14110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587088.931396:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788587088.931644:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208188288:0@lo:400:kworker.0 00000100:00100000:2.0:1788587089.411747:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208189056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587089.411834:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587089.412103:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189056 00000100:00100000:1.0:1788587089.412112:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189056 00000100:00100000:1.0:1788587089.412182:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788587089.412192:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208189056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587089.412230:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587089.412297:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208189056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587089.412304:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788587089.412389:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac9071d500 x1875469208189056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587089.412410:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208189056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587089.604877:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587090.627347:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587090.960421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587090.960542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587090.960574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587090.960649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937408 00000100:00100000:3.0:1788587090.960659:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937408 00000100:00100000:3.0:1788587090.960707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 289 00000100:00100000:3.0:1788587090.960718:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181937408:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587090.960790:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181937408:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 71us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587090.960797:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 289 00000100:00100000:1.0:1788587090.960871:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937536 00000100:00100000:1.0:1788587090.960877:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937536 00000100:00100000:1.0:1788587090.960928:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937664 00000100:00100000:1.0:1788587090.960931:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937664 00000100:00100000:1.0:1788587090.960955:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00100000:1.0:1788587090.960961:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181937536:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587090.960995:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181937536:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587090.961001:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00100000:1.0:1788587090.961014:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 140 00000100:00100000:1.0:1788587090.961020:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181937664:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587090.961044:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181937664:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587090.961050:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 140 00000100:00080000:1.0:1788587090.961066:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788587091.421729:0:11874:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 01:44:49 (1788587089) 00010000:00010000:0.0:1788587091.653125:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587092.675257:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587093.700724:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587093.769720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587093.769840:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937792 00000100:00100000:1.0:1788587093.769872:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937792 00000100:00100000:1.0:1788587093.769962:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:1.0:1788587093.769976:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:10240:x1875469181937792:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587093.770001:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587093.770040:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c274a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.770128:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88cd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.770143:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.770157:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587093.770192:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587093.770197:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587093.770237:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.770261:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c274a expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.770279:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c274a expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.770417:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025f00) 00010000:00010000:1.0:1788587093.770420:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587093.770424:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52bc00, rc 0) 00000100:00100000:1.0:1788587093.770493:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:10240:x1875469181937792:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 520us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587093.770500:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00080000:2.0:1788587093.771305:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587093.800027:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587093.800142:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181937920 00000100:00100000:1.0:1788587093.800168:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181937920 00000100:00100000:1.0:1788587093.800229:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:1.0:1788587093.800240:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:10241:x1875469181937920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587093.800261:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587093.800283:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88cda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2751 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800359:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800374:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800389:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800403:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800411:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800417:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800652:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88cef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800661:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88cef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800669:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88cef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587093.800704:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587093.800708:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587093.800729:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88cef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800752:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800759:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800766:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800772:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587093.800776:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800783:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800796:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025f00) 00010000:00010000:1.0:1788587093.800799:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587093.800804:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800811:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800825:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800897:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800905:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800911:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587093.800914:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800921:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800930:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8baca1025300) 00010000:00010000:1.0:1788587093.800933:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587093.800936:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800942:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88ce8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800975:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88cda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2751 expref: 8 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800987:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88cef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2751 expref: 7 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.800995:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baca1025d00) 00010000:00010000:1.0:1788587093.800997:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587093.801007:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52b000, rc 0) 00000100:00100000:1.0:1788587093.801082:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:10241:x1875469181937920:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 844us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587093.801090:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:0.0:1788587093.808574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587093.808657:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181938176 00000100:00100000:1.0:1788587093.808668:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181938176 00000100:00100000:1.0:1788587093.808728:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:1.0:1788587093.808739:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:10241:x1875469181938176:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587093.808762:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587093.808787:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88cf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2758 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.808888:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.808904:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.808915:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.808976:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.808984:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.808990:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.809997:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88d0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810018:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88d0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810026:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88d0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587093.810383:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788587093.810568:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810577:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810584:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810589:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587093.810593:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810600:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810612:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baca1025d00) 00010000:00010000:1.0:1788587093.810615:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587093.810619:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810626:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88cfd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810640:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810653:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810660:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810665:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587093.810668:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810673:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810681:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8baca1025b00) 00010000:00010000:1.0:1788587093.810684:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587093.810687:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.810693:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88d04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.811321:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab88cf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2758 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.811340:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88d0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2758 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587093.811347:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:1.0:1788587093.811349:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587093.811357:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52be00, rc 0) 00000100:00100000:1.0:1788587093.811436:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:10241:x1875469181938176:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 2698us (2875us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788587093.811446:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:2.0:1788587093.833554:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587093.833669:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181938304 00000100:00100000:1.0:1788587093.833682:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181938304 00000100:00100000:1.0:1788587093.833748:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:1.0:1788587093.833758:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:10241:x1875469181938304:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788587093.833911:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:10241:x1875469181938304:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 Request processed in 154us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587093.833919:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:0.0:1788587094.021726:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587094.021750:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208189184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587094.021820:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587094.022184:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208189312:0@lo:400:kworker.0 00000100:00100000:2.0:1788587094.022217:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208189440:0@lo:400:kworker.0 00000100:00100000:0.0:1788587094.022225:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587094.022258:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587094.022262:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208189824:0@lo:400:kworker.0 00000100:00100000:2.0:1788587094.022286:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587094.022294:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208189568:0@lo:400:kworker.0 00000100:00100000:0.0:1788587094.022301:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587094.022325:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587094.022328:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587094.022337:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208189696:0@lo:400:kworker.0 00000100:00100000:2.0:1788587094.022363:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189440 00000100:00100000:0.0:1788587094.022367:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587094.022372:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189440 00000100:00100000:2.0:1788587094.022416:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189568 00000100:00100000:2.0:1788587094.022418:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189568 00000100:00100000:0.0:1788587094.022432:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189696 00000100:00100000:0.0:1788587094.022437:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189696 00000100:00100000:2.0:1788587094.022447:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788587094.022458:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208189440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587094.022469:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788587094.022479:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208189568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587094.022529:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208189440:12345-0@lo:400:kworker.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587094.022538:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788587094.022539:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208189568:12345-0@lo:400:kworker.0 Request processed in 60us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587094.022549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788587094.022561:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788587094.022569:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208189696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587094.022609:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208189696:12345-0@lo:400:kworker.0 Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587094.022615:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788587094.022632:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587094.022656:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208189568:0@lo:400:kworker.0 00000100:00100000:2.0:1788587094.022665:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208189440:0@lo:400:kworker.0 00000100:00100000:0.0:1788587094.022705:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208189696:0@lo:400:kworker.0 00000100:00100000:1.0:1788587094.022752:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189824 00000100:00100000:0.0:1788587094.022756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189312 00000100:00100000:1.0:1788587094.022757:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189824 00000100:00100000:0.0:1788587094.022763:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189312 00000100:00100000:0.0:1788587094.022800:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788587094.022810:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587094.022811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208189312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587094.022822:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208189824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587094.022878:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208189824:12345-0@lo:400:kworker.0 Request processed in 60us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587094.022885:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587094.022891:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208189312:12345-0@lo:400:kworker.0 Request processed in 84us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587094.022899:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788587094.022928:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189184 00000100:00100000:1.0:1788587094.022932:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189184 00010000:00080000:0.0:1788587094.022947:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacbb8daa00 x1875469208189824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788587110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587094.022972:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208189824:0@lo:400:kworker.0 00000100:00100000:1.0:1788587094.022977:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587094.022985:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208189184:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587094.022989:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208189312:0@lo:400:kworker.0 00002000:00000024:1.0:1788587094.023017:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587094.023056:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208189184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587094.023063:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788587094.023583:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208189184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788587094.023701:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587094.023705:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788587094.467964:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587094.533618:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587094.533654:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208189952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587094.533727:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587094.533799:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208189952 00000100:00100000:1.0:1788587094.533808:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208189952 00000100:00100000:1.0:1788587094.533883:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788587094.533893:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208189952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587094.533929:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587094.533976:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208189952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587094.533983:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788587094.534026:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bac83053480 x1875469208189952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587094.534045:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208189952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788587094.724225:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788587095.130299:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1788587095.747969:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587095.960698:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587095.960939:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181938432 00000100:00100000:3.0:1788587095.960949:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181938432 00000100:00100000:3.0:1788587095.961020:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:3.0:1788587095.961030:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:10283:x1875469181938432:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587095.961050:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587095.961069:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88d19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c275f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961138:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961154:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961167:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961195:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788587095.961327:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587095.961358:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961367:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961565:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961572:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961579:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961584:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587095.961590:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961597:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961609:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025f00) 00010000:00010000:3.0:1788587095.961612:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587095.961618:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961624:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961640:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961645:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961650:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961655:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587095.961658:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961663:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961669:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8bac987bcb00) 00010000:00010000:3.0:1788587095.961671:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587095.961673:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961678:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961709:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88d19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c275f expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961798:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025f00) 00010000:00010000:3.0:1788587095.961801:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587095.961811:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88d19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c275f expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587095.961821:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5c00, rc 0) 00000100:00100000:3.0:1788587095.962070:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:10283:x1875469181938432:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1040us (1380us total) trans 0 rc 301/301 00000100:00100000:3.0:1788587095.962078:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788587095.981495:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587095.981569:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181938688 00000100:00100000:1.0:1788587095.981581:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181938688 00000100:00100000:1.0:1788587095.981649:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1788587095.981659:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:10283:x1875469181938688:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1788587095.981712:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587095.981751:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88cd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c274a expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.981770:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025f00) 00010000:00010000:1.0:1788587095.981780:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587095.982039:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.982055:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.982076:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.982090:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.982098:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.982106:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587095.988603:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788587095.988640:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.988836:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.988874:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.988881:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587095.988887:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.988896:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.989338:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca1025600) 00010000:00010000:1.0:1788587095.989342:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587095.989366:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.989373:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88d2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587095.989404:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019b0315c reply state 000000001d981281 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587095.989415:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587095.989582:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:10283:x1875469181938688:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 7918us (8102us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788587095.989592:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00010000:00010000:1.0:1788587095.992430:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.992451:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.992459:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.992465:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587095.992471:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.992490:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.992512:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8baca1025300) 00010000:00010000:1.0:1788587095.992516:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587095.992521:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587095.992539:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88d35 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587096.081376:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587096.082091:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587096.082126:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181938944 00000100:00100000:1.0:1788587096.082134:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181938944 00000100:00100000:1.0:1788587096.082198:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00100000:1.0:1788587096.082221:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181938944:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587096.082309:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181938944:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 91us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587096.082317:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00080000:2.0:1788587096.084795:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587096.085267:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181938816 00000100:00100000:1.0:1788587096.085278:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181938816 00000100:00100000:1.0:1788587096.085340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 291 00000100:00100000:1.0:1788587096.085352:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181938816:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587096.085454:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181938816:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 105us (4087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587096.085461:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 291 00000100:00100000:1.0:1788587096.099518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587096.099603:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181939072 00000100:00100000:2.0:1788587096.099616:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181939072 00000100:00100000:2.0:1788587096.099686:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1788587096.099699:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:10291:x1875469181939072:12345-192.168.204.28@tcp:101:lctl.0 00010000:00010000:2.0:1788587096.099741:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587096.099771:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88d3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2766 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.100104:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88d43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.100124:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88d43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.100138:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88d43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587096.100216:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587096.100220:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587096.101457:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88d43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.101513:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88d3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2766 expref: 10 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.101530:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88d43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2766 expref: 9 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.101539:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:2.0:1788587096.101542:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587096.101546:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5c00, rc 0) 00000100:00100000:2.0:1788587096.101623:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:10291:x1875469181939072:12345-192.168.204.28@tcp:101:lctl.0 Request processed in 1928us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587096.101633:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:1.0:1788587096.165382:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.165467:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181939200 00000100:00100000:3.0:1788587096.165492:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181939200 00000100:00100000:3.0:1788587096.165563:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:3.0:1788587096.165575:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:10297:x1875469181939200:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587096.165603:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587096.165629:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88d4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c276d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165710:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165749:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165764:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165784:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165792:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165799:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165962:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88d5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165971:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.165978:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587096.166015:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788587096.166020:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587096.166058:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166071:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166077:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166082:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166087:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587096.166092:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166099:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166112:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:3.0:1788587096.166122:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587096.166128:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166135:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88d51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166149:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166154:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166160:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166165:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587096.166167:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166173:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166181:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8bac987bcb00) 00010000:00010000:3.0:1788587096.166183:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587096.166186:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166191:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166430:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5c00/0xc1a730b05ab88d4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c276d expref: 11 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166460:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c276d expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.166466:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587096.166469:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788587096.166471:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5e00, rc 0) 00000100:00100000:3.0:1788587096.166564:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:10297:x1875469181939200:12345-192.168.204.28@tcp:101:bash.0 Request processed in 991us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.166573:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:1.0:1788587096.178566:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587096.178652:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181939456 00000100:00100000:2.0:1788587096.178663:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181939456 00000100:00100000:2.0:1788587096.178733:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:2.0:1788587096.178744:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:10297:x1875469181939456:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587096.178766:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587096.179040:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab88d66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2774 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.179210:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.179226:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.179237:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.179253:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.179260:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.179267:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587096.180017:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788587096.180190:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180212:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180223:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180267:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180276:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180283:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180289:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587096.180294:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180301:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180313:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587096.180315:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587096.180319:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180325:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88d6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587096.180336:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fac1864 reply state 000000002176018a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587096.180349:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788587096.180383:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab88d66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180397:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.180405:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439000) 00010000:00010000:0.0:1788587096.180406:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587096.180409:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788587096.180504:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:10297:x1875469181939456:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1761us (1950us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788587096.180512:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00010000:00010000:2.0:1788587096.186594:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.186613:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.186640:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.186647:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587096.186653:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.186661:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.186681:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac90439700) 00010000:00010000:2.0:1788587096.186684:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587096.186689:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.186695:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab88d74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587096.188928:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.189220:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181939584 00000100:00100000:3.0:1788587096.189229:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181939584 00000100:00100000:3.0:1788587096.189275:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:3.0:1788587096.189283:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875469181939584:12345-192.168.204.28@tcp:8:bash.0 00010000:00080000:3.0:1788587096.189314:0:6708:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:3.0:1788587096.189355:0:6708:0:(genops.c:1385:class_connect()) connect: client 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8, cookie 0xc1a730b05ab88d89 00002000:00100000:3.0:1788587096.189368:0:6708:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8/ffff8bac92c3e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788587096.189392:0:6708:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788587096.189977:0:6708:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788587096.190013:0:6708:0:(import.c:65:import_set_state_nolock()) ffff8bac92c38000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587096.191876:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2358:x1875469181939584:12345-192.168.204.28@tcp:8:bash.0 Request processed in 2574us (2940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.191892:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1788587096.203487:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587096.204981:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181939712 00000100:00100000:2.0:1788587096.205001:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181939712 00000100:00100000:2.0:1788587096.205159:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1788587096.205171:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:0:x1875469181939712:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587096.205190:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587096.205224:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c277b expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587096.205785:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587096.205810:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1788587096.205829:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587096.205882:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.205915:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.205932:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4200, rc 0) 00000100:00100000:2.0:1788587096.206009:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:0:x1875469181939712:12345-192.168.204.28@tcp:101:bash.0 Request processed in 839us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587096.206017:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:1.0:1788587096.209761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.209940:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181939840 00000100:00100000:3.0:1788587096.209951:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181939840 00000100:00100000:3.0:1788587096.210029:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1788587096.210042:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:10297:x1875469181939840:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587096.210063:0:10779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587096.210086:0:10779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2782 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.210120:0:10779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.210130:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587096.210135:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587096.210141:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 8 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.210211:0:10779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.210226:0:10779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 8 pid: 6706 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587096.210247:0:10779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10779:1875469208190080:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587096.210339:0:10779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baca1271840 going to sleep for 11 seconds 00000100:00080000:0.0:1788587096.211912:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587096.216307:0:10779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10779:1875469208190080:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587096.216356:0:10779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 8 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.216403:0:10779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5c00, rc 0) 00000100:00100000:3.0:1788587096.216468:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:10297:x1875469181939840:12345-192.168.204.28@tcp:101:bash.0 Request processed in 6428us (6719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.216486:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:1.0:1788587096.223311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.223513:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181939968 00000100:00100000:3.0:1788587096.223528:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181939968 00010000:00010000:3.0:1788587096.223570:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 8 pid: 6706 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587096.223620:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1788587096.223630:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181939968:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587096.223647:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587096.223673:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 8 pid: 6706 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.223687:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 8 pid: 6706 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.223728:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab88d90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c277b expref: 8 pid: 6706 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.223747:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587096.223751:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587096.223760:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.223789:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.223829:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587096.223902:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875469208190208:192.168.204.28@tcp:105: 00000100:00100000:3.0:1788587096.223979:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8baca1271840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587096.227836:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875469208190208:192.168.204.28@tcp:105: 00010000:00010000:3.0:1788587096.228141:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587096.229179:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181939968:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5542us (5872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587096.229195:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:1.0:1788587096.232375:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.232473:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181940224 00000100:00100000:3.0:1788587096.232569:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181940224 00000100:00100000:3.0:1788587096.232673:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1788587096.232685:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:10297:x1875469181940224:12345-192.168.204.28@tcp:35:bash.0 00000001:00080000:3.0:1788587096.233317:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:3.0:1788587096.233535:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:10297:x1875469181940224:12345-192.168.204.28@tcp:35:bash.0 Request processed in 850us (1169us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788587096.233544:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000020:00080000:3.0:1788587096.233549:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587096.325696:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.325886:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181940480 00000100:00100000:3.0:1788587096.325898:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181940480 00000100:00100000:3.0:1788587096.325974:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1788587096.325984:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:10307:x1875469181940480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587096.326008:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587096.326040:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587096.326154:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587096.326432:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2789 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.326448:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:3.0:1788587096.326451:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587096.326456:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88d9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2789 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.326470:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5600, rc 0) 00000100:00100000:3.0:1788587096.326538:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:10307:x1875469181940480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 556us (854us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1788587096.326545:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:1.0:1788587096.331310:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587096.331459:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181940736 00000100:00100000:0.0:1788587096.331471:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181940736 00000100:00100000:0.0:1788587096.331546:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:0.0:1788587096.331559:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:10307:x1875469181940736:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587096.332619:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:10307:x1875469181940736:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1059us (1315us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788587096.332629:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1788587096.500604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.500706:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181940864 00000100:00100000:3.0:1788587096.500719:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181940864 00000100:00100000:3.0:1788587096.500788:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:3.0:1788587096.500801:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:10313:x1875469181940864:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587096.500828:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587096.500876:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88dac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2790 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.500948:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.500963:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.500990:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587096.501030:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788587096.501034:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587096.501053:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.501367:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88dac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2790 expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.501390:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2790 expref: 17 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.501398:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587096.501401:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587096.501405:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4e00, rc 0) 00000100:00100000:3.0:1788587096.501468:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:10313:x1875469181940864:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 670us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.501485:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:1.0:1788587096.525085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.525937:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181941120 00000100:00100000:3.0:1788587096.525949:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181941120 00000100:00100000:3.0:1788587096.526022:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1788587096.526033:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:10313:x1875469181941120:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587096.526056:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587096.526079:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88dba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2797 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.526390:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.526410:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.526425:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587096.526525:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788587096.526677:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5600/0xc1a730b05ab88dba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2797 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.526699:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2797 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.526708:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439000) 00010000:00010000:3.0:1788587096.526711:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587096.526714:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051800, rc 0) 00000100:00100000:3.0:1788587096.527650:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:10313:x1875469181941120:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1613us (2582us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788587096.527660:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:1.0:1788587096.534288:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.535370:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181941248 00000100:00100000:3.0:1788587096.535384:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181941248 00000100:00100000:3.0:1788587096.538374:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:3.0:1788587096.538401:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:2361:x1875469181941248:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587096.538427:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587096.538490:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2797 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.538513:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439000) 00010000:00010000:3.0:1788587096.538520:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587096.545336:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2361:x1875469181941248:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 6927us (11040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.545356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1788587096.548989:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587096.549185:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181941504 00000100:00100000:0.0:1788587096.549199:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181941504 00000100:00100000:0.0:1788587096.549268:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:0.0:1788587096.549279:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:10313:x1875469181941504:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587096.549326:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587096.549349:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab88dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c279e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.549466:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88dd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.549491:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.549505:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587096.549519:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587096.549654:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab88dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c279e expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.549677:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c279e expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.549687:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439000) 00010000:00010000:0.0:1788587096.549690:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587096.549694:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98000, rc 0) 00000100:00100000:0.0:1788587096.549768:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:10313:x1875469181941504:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 491us (795us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788587096.549775:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:1.0:1788587096.571037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587096.571349:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181941632 00000100:00100000:2.0:1788587096.571360:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181941632 00000100:00100000:2.0:1788587096.571432:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1788587096.571445:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469181941632:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1788587096.571509:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.571533:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.571541:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587096.571558:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587096.571564:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.571601:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.571616:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 7 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587096.571631:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875469208190336:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587096.571829:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587096.581320:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875469208190336:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587096.581357:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587096.582132:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587096.582333:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181941760 00000100:00100000:2.0:1788587096.582341:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181941760 00002000:00100000:2.0:1788587096.582392:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8bacaf2b7b80 x1875469181941760/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:412/0 lens 504/0 e 0 to 0 dl 1788587107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587096.582402:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacaf2b7b80 with x1875469181941760 ext(0->12) 00010000:00010000:2.0:1788587096.582410:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 8 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.582427:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 8 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587096.582435:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacaf2b7b80 00000100:00100000:2.0:1788587096.582482:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1788587096.582493:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181941760:12345-192.168.204.28@tcp:4:lfs.0 00000001:00100000:0.0:1788587096.644410:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000100:00100000:3.0:1788587096.645115:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2362:x1875469181941760:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 62614us (62977us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788587096.645133:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00002000:00100000:3.0:1788587096.645147:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8bacaf2b7b80 x1875469181941760/t4294967299(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:412/0 lens 504/448 e 0 to 0 dl 1788587107 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587096.645158:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacaf2b7b80 with x1875469181941760 ext(0->12) 00010000:00010000:3.0:1788587096.645172:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 9 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.645198:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 9 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587096.645207:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacaf2b7b80 00000100:00100000:2.0:1788587096.648130:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587096.648214:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181941888 00000100:00100000:0.0:1788587096.648290:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181941888 00010000:00010000:0.0:1788587096.648334:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 9 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587096.648379:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788587096.648390:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2359:x1875469181941888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587096.648405:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788587096.648424:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788587096.648427:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788587096 00002000:00010000:0.0:1788587096.648430:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788587096 00002000:00010000:0.0:1788587096.648431:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788587096 00010000:00010000:0.0:1788587096.648437:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 9 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.648451:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 9 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.648489:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fbc7972/0xc1a730b05ab88d97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2782 expref: 9 pid: 10779 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.648508:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587096.648512:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587096.648518:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.648528:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.648567:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587096.648785:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.648795:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.648823:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.648831:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.648970:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.648980:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587096.648993:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.649003:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.649016:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587096.649025:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab88de4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587096.649387:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2359:x1875469181941888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 997us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587096.649396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:1.0:1788587096.649456:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469181941632:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 78014us (78433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587096.649465:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1788587096.652461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.652550:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181942144 00000100:00100000:3.0:1788587096.652560:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181942144 00000100:00100000:3.0:1788587096.652652:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788587096.652663:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:10313:x1875469181942144:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:3.0:1788587096.652729:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c279e expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587096.653150:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788587096.653198:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788587096.654704:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:2.0:1788587096.654790:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.654811:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.654821:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.655078:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.655099:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 24 pid: 5852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587096.655116:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208190464:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587096.655241:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58be600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587096.658726:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208190464:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587096.658761:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587096.659614:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587096.659832:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181942272 00000100:00100000:0.0:1788587096.659868:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181942272 00010000:00010000:0.0:1788587096.659919:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 25 pid: 5852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587096.659955:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:0.0:1788587096.659964:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:2362:x1875469181942272:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587096.659978:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587096.659984:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 25 pid: 5852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.659996:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 25 pid: 5852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.660018:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2774 expref: 25 pid: 5852 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.660035:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439000) 00010000:00010000:0.0:1788587096.660052:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.660386:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.660395:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.660432:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587096.660494:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:2362:x1875469181942272:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 530us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587096.660503:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00010000:00010000:2.0:1788587096.660575:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.660584:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587096.660702:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1788587096.660943:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788587096.661052:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208190592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788587096.661102:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587096.661140:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587096.661215:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208190592 00000100:00100000:3.0:1788587096.661221:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208190592 00000100:00100000:3.0:1788587096.661285:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587096.661294:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208190592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587096.661367:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208190592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.661375:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587096.661592:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208190592:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1788587096.662398:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788587096.668439:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788587096.668894:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208190720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788587096.669044:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587096.669149:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58bef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587096.670518:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208190720 00000100:00100000:3.0:1788587096.670532:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208190720 00000100:00100000:3.0:1788587096.670599:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587096.670611:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208190720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587096.670891:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875469208190720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 282us (1846us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788587096.670899:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587096.670930:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208190720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788587096.671192:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788587096.671319:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.671331:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.671340:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.671346:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587096.671351:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.671359:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.671374:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439000) 00010000:00010000:2.0:1788587096.671386:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788587096.671391:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587096.671414:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88deb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587096.671917:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788587096.672242:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788587096.672324:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418876480400ns, next at 419876477843ns, rc = 0 00000001:00080000:2.0:1788587096.672333:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788587096.672375:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439000) 00010000:00010000:2.0:1788587096.672379:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587096.672387:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab88dd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c279e expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587096.672523:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:10313:x1875469181942144:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 19861us (20072us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788587096.672532:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000020:00080000:2.0:1788587096.672536:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788587096.676829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.676944:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181942400 00000100:00100000:3.0:1788587096.676955:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181942400 00000100:00100000:3.0:1788587096.677020:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1788587096.677031:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:10313:x1875469181942400:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587096.677060:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587096.677194:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27a5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.677429:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27a5 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.677465:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27a5 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.677499:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587096.677504:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587096.677508:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051800, rc 0) 00000100:00100000:3.0:1788587096.677572:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:10313:x1875469181942400:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 544us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.677580:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:0.0:1788587096.680981:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587096.681095:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181942656 00000100:00100000:2.0:1788587096.681107:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181942656 00000100:00100000:2.0:1788587096.681210:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:2.0:1788587096.681222:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84662c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:10313:x1875469181942656:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587096.681479:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84662c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:10313:x1875469181942656:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 245us (493us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788587096.681489:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00010000:00010000:3.0:1788587096.771741:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587096.773552:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587096.773718:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181942912 00000100:00100000:0.0:1788587096.773729:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181942912 00000100:00100000:0.0:1788587096.774035:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:0.0:1788587096.774049:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:10323:x1875469181942912:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587096.774080:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587096.774105:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88df9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27ac expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587096.774199:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788587096.774455:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88df9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27ac expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.774483:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:0.0:1788587096.774486:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587096.774492:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88df9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27ac expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.774520:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788587096.774590:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:10323:x1875469181942912:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 544us (1057us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1788587096.774597:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:1.0:1788587096.777535:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.777658:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181943040 00000100:00100000:3.0:1788587096.777668:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181943040 00000100:00100000:3.0:1788587096.777763:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:3.0:1788587096.777773:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:10323:x1875469181943040:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1788587096.778084:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778103:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778115:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778133:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778139:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778159:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778337:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778346:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778354:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587096.778539:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778554:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778560:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778567:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778572:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587096.778576:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778583:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778594:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587096.778604:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587096.778609:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778617:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778632:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778638:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778644:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778650:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587096.778653:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778659:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778666:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac987bcb00) 00010000:00010000:3.0:1788587096.778669:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587096.778672:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778678:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778695:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778708:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778713:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778718:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587096.778721:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778727:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778736:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587096.778738:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587096.778741:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.778747:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587096.778937:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:10323:x1875469181943040:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 1163us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.778946:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:2.0:1788587096.781823:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587096.781889:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181943296 00000100:00100000:0.0:1788587096.781900:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181943296 00000100:00100000:0.0:1788587096.781969:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1788587096.781980:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:10323:x1875469181943296:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587096.782241:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:10323:x1875469181943296:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 262us (430us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788587096.782501:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1788587096.830995:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587096.831169:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181943552 00000100:00100000:0.0:1788587096.831179:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181943552 00000100:00100000:0.0:1788587096.831346:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:0.0:1788587096.831359:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:10326:x1875469181943552:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587096.831401:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587096.831428:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27b3 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831525:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831539:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831552:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831582:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831590:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831596:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831726:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831736:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.831743:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587096.831753:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788587096.832090:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832098:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832105:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832111:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587096.832116:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832135:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832148:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587096.832151:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587096.832157:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832164:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832178:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832184:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832190:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832195:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587096.832197:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832203:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832210:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac90439d00) 00010000:00010000:0.0:1788587096.832212:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587096.832215:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832306:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832352:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832366:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587096.832384:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:0.0:1788587096.832387:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587096.832390:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99800, rc 0) 00000100:00100000:0.0:1788587096.832472:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:10326:x1875469181943552:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1107us (1478us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788587096.832480:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:1.0:1788587096.837584:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.837671:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181943680 00000100:00100000:3.0:1788587096.837682:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181943680 00000100:00100000:3.0:1788587096.837747:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:3.0:1788587096.837757:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:10326:x1875469181943680:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1788587096.838168:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838196:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838209:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838241:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838248:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838255:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838262:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587096.838267:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838276:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838289:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587096.838292:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587096.838298:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587096.838305:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587096.838386:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:10326:x1875469181943680:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 630us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587096.838400:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:0.0:1788587096.840899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587096.841145:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181943936 00000100:00100000:3.0:1788587096.841159:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181943936 00000100:00100000:3.0:1788587096.841478:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:2.0:1788587096.842781:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:10326:x1875469181943936:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587096.843515:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:10326:x1875469181943936:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 2023us (2633us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788587096.843526:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:2.0:1788587097.207093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587097.210087:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181944192 00000100:00100000:3.0:1788587097.210103:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181944192 00000100:00080000:1.0:1788587097.210421:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587097.210744:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:3.0:1788587097.210758:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:10357:x1875469181944192:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:3.0:1788587097.210783:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587097.210804:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27ba expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.210948:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.210965:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.210978:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587097.210991:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788587097.211177:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27ba expref: 37 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.211199:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27ba expref: 36 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.211208:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587097.211219:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587097.211223:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587097.211302:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:10357:x1875469181944192:12345-192.168.204.28@tcp:101:cat.0 Request processed in 548us (4220us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788587097.211310:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:1.0:1788587097.223173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587097.223315:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181944320 00000100:00100000:2.0:1788587097.223327:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181944320 00000100:00100000:2.0:1788587097.223401:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1788587097.223414:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88343450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:2362:x1875469181944320:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587097.223431:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587097.223468:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab88e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27ba expref: 36 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.223487:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:2.0:1788587097.223493:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587097.223560:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88343450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:2362:x1875469181944320:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 149us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587097.223567:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:1.0:1788587097.224592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587097.225004:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181944576 00000100:00100000:0.0:1788587097.225013:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181944576 00000100:00100000:0.0:1788587097.225092:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1788587097.225102:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:10357:x1875469181944576:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:0.0:1788587097.225787:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:10357:x1875469181944576:12345-192.168.204.28@tcp:35:cat.0 Request processed in 684us (1200us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788587097.225796:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1788587097.297770:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587097.298003:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181944832 00000100:00100000:1.0:1788587097.298013:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181944832 00000100:00100000:1.0:1788587097.298079:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:1.0:1788587097.298089:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:10363:x1875469181944832:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:1.0:1788587097.298130:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587097.298134:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587097.298160:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab88db3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2790 expref: 36 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.298179:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:1.0:1788587097.298185:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587097.298201:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88e5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27c1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.298312:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.298328:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.298338:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.298387:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.298401:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 36 pid: 5852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587097.298415:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac88269500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208190848:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587097.298716:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587097.301008:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac88269500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208190848:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587097.301038:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587097.306095:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587097.306756:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181944960 00000100:00100000:1.0:1788587097.306781:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181944960 00010000:00010000:1.0:1788587097.306827:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 37 pid: 5852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587097.307099:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:1.0:1788587097.307111:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:2360:x1875469181944960:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587097.307126:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587097.307134:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 37 pid: 5852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.307147:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 37 pid: 5852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.307168:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27b3 expref: 37 pid: 5852 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.307185:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:1.0:1788587097.307191:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.307201:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.307209:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.307386:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587097.307553:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.307562:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587097.307581:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788587097.307757:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab88e5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.307774:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.307781:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587097.307784:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587097.307786:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52a800, rc 0) 00000100:00100000:1.0:1788587097.307835:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:2360:x1875469181944960:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 725us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587097.307922:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:3.0:1788587097.308801:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:10363:x1875469181944832:12345-192.168.204.28@tcp:101:dd.0 Request processed in 10708us (11037us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1788587097.308826:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:1.0:1788587097.312718:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587097.312797:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181945216 00000100:00100000:0.0:1788587097.312808:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181945216 00000100:00100000:0.0:1788587097.312917:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:0.0:1788587097.312943:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:10363:x1875469181945216:12345-192.168.204.28@tcp:36:dd.0 00010000:00010000:0.0:1788587097.313200:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587097.313234:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587097.313246:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587097.313292:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:0.0:1788587097.313315:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000595fee60 reply state 0000000053d83eae transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587097.313324:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587097.313618:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:10363:x1875469181945216:12345-192.168.204.28@tcp:36:dd.0 Request processed in 676us (911us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788587097.313626:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000020:00080000:0.0:1788587097.313631:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587097.329182:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.329202:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.329210:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.330022:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587097.330028:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.330037:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.330056:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:1.0:1788587097.330059:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587097.330064:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.330070:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88e70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587097.671141:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587097.671516:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181945344 00000100:00100000:3.0:1788587097.671529:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181945344 00000100:00100000:3.0:1788587097.671701:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:3.0:1788587097.671713:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:10377:x1875469181945344:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:3.0:1788587097.671739:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587097.671764:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27c8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.671839:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.671897:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.671925:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.671945:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.671952:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.671959:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.672058:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.672089:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.672097:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.672137:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.672154:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 39 pid: 5851 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587097.672173:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208190976:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587097.673062:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacc1800900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587097.677935:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587097.678184:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208190976:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587097.678232:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181945600 00000100:00100000:0.0:1788587097.678241:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181945600 00010000:00010000:3.0:1788587097.678297:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587097.678303:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1788587097.678316:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:5602:x1875469181945600:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788587097.679772:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:5602:x1875469181945600:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 1451us (1841us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788587097.679785:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1788587097.685890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587097.685972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181945728 00000100:00100000:3.0:1788587097.685984:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181945728 00010000:00010000:3.0:1788587097.686029:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 41 pid: 5851 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587097.686078:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:3.0:1788587097.686090:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:2362:x1875469181945728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587097.686106:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587097.686128:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 41 pid: 5851 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.686143:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 41 pid: 5851 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.686166:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88e62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c1 expref: 41 pid: 5851 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.686182:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587097.686188:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.686198:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.686329:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.686369:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587097.686534:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686543:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587097.686600:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788587097.686606:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587097.686647:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686660:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686670:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686676:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686683:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686689:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587097.686693:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686700:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686709:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:1.0:1788587097.686711:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587097.686715:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686721:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab88e7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686743:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686749:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686755:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686760:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587097.686763:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686769:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686777:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac987bcb00) 00010000:00010000:1.0:1788587097.686779:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587097.686782:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686788:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab88e85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686830:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab88e77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c8 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686893:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c8 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587097.686912:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:1.0:1788587097.686914:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587097.686917:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:3.0:1788587097.687228:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:2362:x1875469181945728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1138us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587097.687238:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:1.0:1788587097.687578:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:10377:x1875469181945344:12345-192.168.204.28@tcp:101:stat.0 Request processed in 15865us (16449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587097.687585:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:1.0:1788587097.786259:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587097.786365:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181945984 00000100:00100000:0.0:1788587097.786377:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181945984 00000100:00100000:0.0:1788587097.786469:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:0.0:1788587097.786494:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:10383:x1875469181945984:12345-192.168.204.28@tcp:36:truncate.0 00010000:00010000:0.0:1788587097.786576:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587097.786607:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab88e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27c8 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587097.786627:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:0.0:1788587097.786633:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587097.786921:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587097.786940:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587097.786951:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587097.787008:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:0.0:1788587097.787035:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec575ce4 reply state 000000007417ed5f transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587097.787044:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587097.787176:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:10383:x1875469181945984:12345-192.168.204.28@tcp:36:truncate.0 Request processed in 684us (929us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1788587097.787184:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00000020:00080000:0.0:1788587097.787189:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587097.788629:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.788644:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.788651:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.788673:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587097.788678:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.788685:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.788702:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587097.788705:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587097.788710:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587097.788717:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab88e93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587097.796038:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587097.962183:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587097.962399:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181946112 00000100:00100000:2.0:1788587097.962412:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181946112 00000100:00100000:2.0:1788587097.962498:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:2.0:1788587097.962511:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:10397:x1875469181946112:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:2.0:1788587097.962550:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587097.962576:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88e9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27cf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962674:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962691:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962706:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962722:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962730:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962738:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962887:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962896:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962903:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587097.962943:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788587097.962949:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587097.962973:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.962998:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963008:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963015:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963022:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963029:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587097.963034:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963042:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963055:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587097.963059:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587097.963064:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963071:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963084:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963090:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963103:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963109:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587097.963112:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963119:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963128:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8baca0968f00) 00010000:00010000:2.0:1788587097.963131:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587097.963134:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963139:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab88ea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963180:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab88e9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963194:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 41 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587097.963201:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:2.0:1788587097.963203:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587097.963206:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4e00, rc 0) 00000100:00100000:2.0:1788587097.963505:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:10397:x1875469181946112:12345-192.168.204.28@tcp:101:stat.0 Request processed in 995us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587097.963592:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:2.0:1788587098.088659:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587098.089217:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181946368 00000100:00100000:0.0:1788587098.089229:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181946368 00000100:00100000:0.0:1788587098.089297:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:0.0:1788587098.089308:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:10407:x1875469181946368:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587098.089346:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587098.089370:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27d6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587098.089480:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788587098.089640:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88eb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27d6 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.089656:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:0.0:1788587098.089659:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587098.089665:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27d6 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.089680:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99400, rc 0) 00000100:00100000:0.0:1788587098.089751:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+42:10407:x1875469181946368:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 445us (1116us total) trans 4294967340 rc 301/301 00000100:00100000:0.0:1788587098.089759:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:3.0:1788587098.096261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.096370:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181946624 00000100:00100000:2.0:1788587098.096379:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181946624 00000100:00100000:2.0:1788587098.096452:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1788587098.096463:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+42:10407:x1875469181946624:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587098.096735:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:10407:x1875469181946624:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 273us (482us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788587098.096742:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1788587098.196458:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587098.196656:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181946880 00000100:00100000:1.0:1788587098.196668:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181946880 00000100:00100000:1.0:1788587098.196735:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:1.0:1788587098.196745:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:10413:x1875469181946880:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587098.196773:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587098.196796:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88ec4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27dd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.196955:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.196971:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.196987:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.197022:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.197057:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 44 pid: 5851 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587098.197072:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac88269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208191104:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587098.197172:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c78780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587098.203493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587098.203495:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac88269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208191104:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587098.203527:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587098.203608:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181947008 00000100:00100000:0.0:1788587098.203615:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181947008 00010000:00010000:0.0:1788587098.203652:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 45 pid: 5851 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587098.203681:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:0.0:1788587098.203689:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:2362:x1875469181947008:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587098.203703:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587098.203709:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 45 pid: 5851 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.203739:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 45 pid: 5851 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.203762:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab88eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27cf expref: 45 pid: 5851 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.203779:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:0.0:1788587098.203784:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.203795:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.203803:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.203828:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587098.203875:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.203885:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587098.203905:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:0.0:1788587098.203920:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:2362:x1875469181947008:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 231us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587098.203929:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00010000:00010000:3.0:1788587098.204059:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88ec4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.204088:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.204097:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587098.204099:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587098.204102:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52ba00, rc 0) 00000100:00100000:3.0:1788587098.204324:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:10413:x1875469181946880:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7580us (7886us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788587098.204332:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:1.0:1788587098.207560:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587098.207649:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181947264 00000100:00100000:0.0:1788587098.207660:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181947264 00000100:00100000:0.0:1788587098.207722:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:0.0:1788587098.207733:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:10413:x1875469181947264:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1788587098.208025:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.208043:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.208070:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587098.208128:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:0.0:1788587098.208156:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080112295 reply state 000000003cbe739a transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587098.208166:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587098.208325:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:10413:x1875469181947264:12345-192.168.204.28@tcp:36:bash.0 Request processed in 592us (772us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788587098.208333:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000020:00080000:0.0:1788587098.208338:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587098.210558:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.210575:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.210582:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.210588:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587098.210593:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.210601:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.210619:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:1.0:1788587098.210623:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587098.210628:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587098.210633:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88ed9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587098.214475:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.215131:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181947392 00000100:00100000:2.0:1788587098.215142:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181947392 00000100:00100000:2.0:1788587098.215215:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:2.0:1788587098.215226:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+46:10413:x1875469181947392:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587098.215249:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587098.215270:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27e4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.215366:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.215381:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.215391:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.215455:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.215470:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 47 pid: 5850 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587098.215485:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208191232:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587098.215619:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58becc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587098.220147:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587098.220241:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181947520 00000100:00100000:3.0:1788587098.220252:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181947520 00010000:00010000:3.0:1788587098.220298:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 48 pid: 5850 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587098.220353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1788587098.220364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:2362:x1875469181947520:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587098.220378:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587098.220385:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 48 pid: 5850 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.220399:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 48 pid: 5850 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.220422:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587098.220428:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.220458:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.220466:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.220486:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587098.220547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:2362:x1875469181947520:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 184us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.220553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00010000:00010000:2.0:1788587098.222087:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab88ecb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27dd expref: 47 pid: 5850 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587098.222110:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208191232:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587098.222134:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.222144:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.222149:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587098.222263:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788587098.222268:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587098.222300:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.222337:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88ee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27e4 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.222454:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27e4 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.222462:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:2.0:1788587098.222465:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587098.222468:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5400, rc 0) 00000100:00100000:2.0:1788587098.222598:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+46:10413:x1875469181947392:12345-192.168.204.28@tcp:101:bash.0 Request processed in 7373us (8133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587098.222606:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:0.0:1788587098.226187:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.226328:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181947776 00000100:00100000:2.0:1788587098.226340:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181947776 00000100:00100000:2.0:1788587098.226489:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1788587098.226500:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84663c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+46:10413:x1875469181947776:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1788587098.226735:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84663c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:10413:x1875469181947776:12345-192.168.204.28@tcp:35:bash.0 Request processed in 236us (557us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788587098.226743:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:1.0:1788587098.363191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587098.363748:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181948032 00000100:00100000:3.0:1788587098.363760:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181948032 00000100:00100000:3.0:1788587098.364060:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:3.0:1788587098.364073:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:10423:x1875469181948032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587098.364099:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587098.364122:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88eee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27eb expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587098.364248:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587098.364407:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88eee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27eb expref: 49 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.364423:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:3.0:1788587098.364426:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587098.364433:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88eee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27eb expref: 49 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.364461:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051c00, rc 0) 00000100:00100000:3.0:1788587098.364543:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:10423:x1875469181948032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 473us (1375us total) trans 4294967346 rc 301/301 00000100:00100000:3.0:1788587098.364551:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:1.0:1788587098.369333:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587098.369514:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181948160 00000100:00100000:3.0:1788587098.369525:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181948160 00000100:00100000:3.0:1788587098.369638:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:3.0:1788587098.369650:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:10423:x1875469181948160:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1788587098.369738:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.369757:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.369770:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.369788:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.369794:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.369800:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370106:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370117:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370124:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587098.370210:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370225:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370232:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370238:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370244:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587098.370248:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370256:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370270:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587098.370273:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587098.370277:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370283:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88efc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370297:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370302:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370314:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370320:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587098.370322:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370328:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370337:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac987bc400) 00010000:00010000:3.0:1788587098.370339:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587098.370353:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370360:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88f03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370375:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370381:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370386:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370392:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587098.370394:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370410:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370418:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587098.370420:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587098.370423:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.370428:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587098.370536:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:10423:x1875469181948160:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 887us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.370544:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:1.0:1788587098.373608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587098.373706:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181948416 00000100:00100000:0.0:1788587098.373717:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181948416 00000100:00100000:0.0:1788587098.373812:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1788587098.373824:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:10423:x1875469181948416:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587098.374361:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:10423:x1875469181948416:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 538us (761us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788587098.374369:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1788587098.424609:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587098.424993:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181948672 00000100:00100000:0.0:1788587098.425005:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181948672 00000100:00100000:0.0:1788587098.425070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:0.0:1788587098.425081:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:10426:x1875469181948672:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587098.425105:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587098.425126:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27f2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425244:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425260:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425272:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425287:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425294:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425300:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425414:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425423:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425431:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587098.425451:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788587098.425542:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425550:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425562:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425567:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587098.425571:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425579:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425592:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587098.425595:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587098.425600:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425606:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab88f18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425619:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425626:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425631:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425636:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587098.425638:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425656:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425664:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac90439d00) 00010000:00010000:0.0:1788587098.425666:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587098.425670:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425675:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425719:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27f2 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425733:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27f2 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.425740:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:0.0:1788587098.425742:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587098.425745:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99400, rc 0) 00000100:00100000:0.0:1788587098.425814:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:10426:x1875469181948672:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 735us (1217us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788587098.425822:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:1.0:1788587098.431625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.431716:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181948800 00000100:00100000:2.0:1788587098.431727:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181948800 00000100:00100000:2.0:1788587098.431793:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:2.0:1788587098.431805:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:10426:x1875469181948800:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:2.0:1788587098.432130:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432150:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432181:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432223:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432230:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432237:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432242:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587098.432247:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432255:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432270:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:2.0:1788587098.432273:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587098.432278:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.432285:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587098.432370:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:10426:x1875469181948800:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 566us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587098.432377:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:1.0:1788587098.434513:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587098.434609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181948928 00000100:00100000:3.0:1788587098.434620:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181948928 00000100:00100000:3.0:1788587098.434691:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:3.0:1788587098.434702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:2362:x1875469181948928:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587098.434717:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587098.434742:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab88f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27f2 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.434761:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587098.434766:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587098.434818:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:2362:x1875469181948928:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.434825:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1788587098.438550:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.438642:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181949184 00000100:00100000:2.0:1788587098.438669:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181949184 00000100:00100000:2.0:1788587098.438734:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1788587098.438745:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:10426:x1875469181949184:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587098.439072:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:10426:x1875469181949184:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 328us (532us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788587098.439079:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000040:00080000:2.0:1788587098.564308:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587098.627467:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587098.627643:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181949440 00000100:00100000:0.0:1788587098.627653:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181949440 00000100:00100000:0.0:1788587098.627719:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:0.0:1788587098.627730:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:10444:x1875469181949440:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1788587098.627781:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587098.627812:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88f3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c27f9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.628035:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.628053:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.628065:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587098.628078:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788587098.628744:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab88f3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27f9 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.628767:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27f9 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587098.628777:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:0.0:1788587098.628780:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788587098.628784:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98600, rc 0) 00000100:00100000:0.0:1788587098.629009:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10444:x1875469181949440:12345-192.168.204.28@tcp:101:cat.0 Request processed in 1280us (1555us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788587098.629017:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:1.0:1788587098.668364:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.668591:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181949568 00000100:00100000:2.0:1788587098.668602:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181949568 00000100:00100000:2.0:1788587098.668671:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:2.0:1788587098.668683:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10446:x1875469181949568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587098.668710:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587098.668734:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2800 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.668807:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab88f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.668822:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab88f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.668834:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab88f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587098.668917:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788587098.668921:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587098.668944:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab88f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.668974:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2800 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.669012:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab88f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2800 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.669021:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587098.669024:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587098.669028:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4400, rc 0) 00000100:00100000:2.0:1788587098.669094:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10446:x1875469181949568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 413us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587098.669102:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:1.0:1788587098.679073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.680053:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181949952 00000100:00100000:2.0:1788587098.680065:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181949952 00000100:00100000:2.0:1788587098.680119:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788587098.680131:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10446:x1875469181949952:12345-192.168.204.28@tcp:35:lfs.0 00000001:00080000:2.0:1788587098.680424:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000100:00100000:2.0:1788587098.680565:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10446:x1875469181949952:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 436us (1506us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788587098.680573:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000020:00080000:2.0:1788587098.680579:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587098.684443:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587098.684548:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181950080 00000100:00100000:3.0:1788587098.684558:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181950080 00000100:00100000:3.0:1788587098.684626:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1788587098.684637:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10446:x1875469181950080:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:3.0:1788587098.684652:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788587098.684680:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab88ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27e4 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.684700:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab88f42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27f9 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.684712:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c27a5 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.684723:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587098.684733:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587098.684789:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10446:x1875469181950080:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.684797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:1.0:1788587098.687055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587098.687333:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181950208 00000100:00100000:3.0:1788587098.687355:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181950208 00000100:00100000:3.0:1788587098.687419:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:3.0:1788587098.687442:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10446:x1875469181950208:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:3.0:1788587098.687574:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.687591:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587098.687614:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587098.687976:0:7662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587098.688192:0:7662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788587098.688250:0:7662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788587098.688360:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10446:x1875469181950208:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 929us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587098.688369:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:1.0:1788587098.708165:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587098.708515:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181950336 00000100:00100000:2.0:1788587098.708528:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181950336 00000100:00100000:2.0:1788587098.708594:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:2.0:1788587098.708605:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10448:x1875469181950336:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587098.708626:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587098.708650:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2807 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708735:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708750:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708762:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708774:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708780:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708786:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708941:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708951:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.708958:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587098.708996:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788587098.709001:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587098.709018:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709040:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709048:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709055:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709062:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709068:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587098.709072:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709080:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709092:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587098.709095:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587098.709100:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709106:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab88f6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709118:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709125:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709136:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709141:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587098.709144:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709150:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709158:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8baca0968d00) 00010000:00010000:2.0:1788587098.709161:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587098.709163:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709168:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab88f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709200:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab88f65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709213:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587098.709220:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc400) 00010000:00010000:2.0:1788587098.709223:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587098.709225:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5e00, rc 0) 00000100:00100000:2.0:1788587098.711040:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10448:x1875469181950336:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2426us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587098.711069:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00010000:00010000:3.0:1788587098.819039:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587099.139104:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587099.139129:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208191360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587099.139212:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.139357:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208191616:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.139388:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.139410:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788587099.139415:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208191488:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.139455:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.139478:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208192000:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.139502:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.139534:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208191488 00000100:00100000:0.0:1788587099.139541:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208191488 00000100:00100000:0.0:1788587099.139583:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788587099.139592:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208191488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.139651:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208191488:12345-0@lo:400:kworker.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.139659:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788587099.139709:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208191488:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.139735:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208191744:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.139758:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.139776:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587099.139782:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208191872:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.139803:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587099.139829:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208191616 00000100:00100000:0.0:1788587099.139833:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208191616 00000100:00100000:0.0:1788587099.139903:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208191744 00000100:00100000:0.0:1788587099.139907:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208191744 00000100:00100000:0.0:1788587099.139930:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208191872 00000100:00100000:0.0:1788587099.139933:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208191872 00000100:00100000:0.0:1788587099.139949:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788587099.139964:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208191616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.140005:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208191616:12345-0@lo:400:kworker.0 Request processed in 41us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.140012:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788587099.140025:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788587099.140031:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208191744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.140060:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208191744:12345-0@lo:400:kworker.0 Request processed in 30us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.140067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788587099.140077:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788587099.140083:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208191872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.140109:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208191872:12345-0@lo:400:kworker.0 Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.140115:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1788587099.140136:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587099.140158:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208191616:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.140181:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208191872:0@lo:400:kworker.0 00000100:00100000:0.0:1788587099.140190:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208191744:0@lo:400:kworker.0 00000100:00100000:2.0:1788587099.140344:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208191360 00000100:00100000:2.0:1788587099.140349:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208191360 00000100:00100000:2.0:1788587099.140394:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587099.140401:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208191360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587099.140444:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587099.140483:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208191360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.140489:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788587099.140741:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587099.140770:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208191360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587099.141287:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208192000 00000100:00100000:1.0:1788587099.141293:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208192000 00000100:00100000:1.0:1788587099.141344:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587099.141351:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875469208192000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587099.141404:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875469208192000:12345-0@lo:400:kworker.0 Request processed in 54us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.141411:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587099.141464:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208192000:0@lo:400:kworker.0 00000100:00080000:2.0:1788587099.141514:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1788587099.378774:0:12024:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587099.378783:0:12024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587099.378819:0:12024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788587099.378825:0:12024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788587099.587102:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587099.587117:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587099.587194:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788587099.587201:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587099.587335:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8dbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208192128:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587099.587450:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58be780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587099.597139:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8dbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208192128:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587099.604438:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.604762:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181950464 00000100:00100000:3.0:1788587099.604774:0:5861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181950464 00000100:00100000:3.0:1788587099.604913:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1788587099.604924:0:5861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10460:x1875469181950464:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788587099.605001:0:5861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10460:x1875469181950464:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 Request processed in 78us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.605010:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00080000:2.0:1788587099.605500:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587099.607529:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.608666:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181950592 00000100:00100000:0.0:1788587099.608677:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181950592 00000100:00100000:0.0:1788587099.608746:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:0.0:1788587099.608757:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10460:x1875469181950592:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587099.608792:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587099.609013:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10460:x1875469181950592:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 257us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.609021:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:1.0:1788587099.613737:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.613943:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181950720 00000100:00100000:0.0:1788587099.613953:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181950720 00000100:00100000:0.0:1788587099.614013:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:0.0:1788587099.614025:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10460:x1875469181950720:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788587099.614150:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614191:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614204:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614220:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614227:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614247:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614275:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614284:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614291:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587099.614332:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788587099.614336:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587099.614351:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614363:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614380:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614387:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614394:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587099.614397:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614405:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614425:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:1.0:1788587099.614428:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587099.614432:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614438:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab88f81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614451:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614457:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614462:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614466:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587099.614475:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614481:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614488:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8baca1025300) 00010000:00010000:1.0:1788587099.614490:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587099.614493:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614499:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab88f88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614515:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614521:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614526:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614532:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587099.614535:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614542:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614549:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc400) 00010000:00010000:1.0:1788587099.614550:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587099.614560:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.614566:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88f8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.614648:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10460:x1875469181950720:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 625us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.614656:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:1.0:1788587099.617984:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.618483:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181950976 00000100:00100000:0.0:1788587099.618493:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181950976 00000100:00100000:0.0:1788587099.618559:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:0.0:1788587099.618570:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10460:x1875469181950976:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587099.618592:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587099.618614:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88f96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c280e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618718:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618735:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618766:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587099.618780:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788587099.618910:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618918:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618925:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618931:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587099.618937:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618944:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618958:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc400) 00010000:00010000:0.0:1788587099.618961:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587099.618967:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.618973:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88f9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.619015:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88f96 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c280e expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.619036:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:0.0:1788587099.619039:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587099.619043:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88f96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c280e expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.619052:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788587099.619123:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10460:x1875469181950976:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 555us (1249us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1788587099.619131:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:2.0:1788587099.624152:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.624470:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181951104 00000100:00100000:3.0:1788587099.624482:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181951104 00000100:00100000:3.0:1788587099.624545:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:3.0:1788587099.624555:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10460:x1875469181951104:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587099.624592:0:7662:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587099.624732:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10460:x1875469181951104:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 178us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.624740:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:1.0:1788587099.630618:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.630735:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181951360 00000100:00100000:3.0:1788587099.630760:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181951360 00000100:00100000:3.0:1788587099.630993:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:3.0:1788587099.631006:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10460:x1875469181951360:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587099.631039:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587099.631042:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788587099.631074:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab88f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2800 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.631094:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587099.631099:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587099.631114:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88fab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2815 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587099.631569:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788587099.631788:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88fb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.631800:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.631810:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.632050:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab88fab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2815 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.632070:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2815 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.632090:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587099.632092:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587099.632095:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051800, rc 0) 00000100:00100000:3.0:1788587099.632169:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10460:x1875469181951360:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 1165us (1560us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788587099.632178:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:0.0:1788587099.636165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.636421:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181951616 00000100:00100000:3.0:1788587099.636433:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181951616 00000100:00100000:3.0:1788587099.636555:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:3.0:1788587099.636566:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10460:x1875469181951616:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587099.636651:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587099.636680:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab88fb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2815 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636699:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac987bce00) 00010000:00010000:3.0:1788587099.636710:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587099.636732:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636744:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636755:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636769:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636788:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636794:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636901:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636908:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636915:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636920:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587099.636924:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636931:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636945:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587099.636948:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587099.636952:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636958:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88fc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636967:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636978:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636983:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636987:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587099.636990:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.636995:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.637002:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x79304449 (ffff8bac987bc800) 00010000:00010000:3.0:1788587099.637004:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587099.637007:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.637011:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88fc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x79304449 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.637106:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10460:x1875469181951616:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 541us (951us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587099.637113:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:2.0:1788587099.648473:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.648576:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181951744 00000100:00100000:0.0:1788587099.648586:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181951744 00000100:00100000:0.0:1788587099.648641:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:0.0:1788587099.648650:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10460:x1875469181951744:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587099.648670:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587099.648693:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c281c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.648737:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.648751:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.648764:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.648936:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.648958:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.648967:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:0.0:1788587099.648970:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587099.648974:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99800, rc 0) 00000100:00100000:0.0:1788587099.649032:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10460:x1875469181951744:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 383us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.649039:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 74 00000004:00080000:1.0:1788587099.651016:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 421855170590ns, next at 422855167852ns, rc = 0 00000100:00100000:2.0:1788587099.651087:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587099.651109:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208192256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587099.651181:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587099.651419:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208192256 00000100:00100000:1.0:1788587099.651428:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208192256 00000100:00100000:1.0:1788587099.651486:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587099.651495:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208192256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587099.651531:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587099.651590:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208192256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.651597:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788587099.651745:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208192256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587099.666699:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587099.666801:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181952000 00000100:00100000:1.0:1788587099.666814:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181952000 00000100:00100000:1.0:1788587099.666921:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:1.0:1788587099.666932:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10460:x1875469181952000:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587099.667020:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.667038:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.667063:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587099.668015:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788587099.668029:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421872185002ns, next at 422872182537ns, rc = 0 00000004:00010000:1.0:1788587099.668132:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006db47c71 reply state 000000003a417327 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.668142:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587099.668678:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:10460:x1875469181952000:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 1744us (1984us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788587099.668689:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:2.0:1788587099.679366:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.679518:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181952128 00010000:00010000:3.0:1788587099.679530:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.679530:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181952128 00010000:00010000:3.0:1788587099.679545:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.679572:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.679580:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587099.679585:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.679594:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.679611:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:3.0:1788587099.679614:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587099.679619:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.679625:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab88fdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.679676:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:0.0:1788587099.679688:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:10460:x1875469181952128:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587099.679715:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587099.679735:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2823 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.679805:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.679819:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.679888:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:0.0:1788587099.679892:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587099.679895:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788587099.679947:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:10460:x1875469181952128:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 263us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.679955:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:2.0:1788587099.686696:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587099.686912:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181952256 00000100:00100000:1.0:1788587099.686923:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181952256 00000100:00100000:1.0:1788587099.686985:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:1.0:1788587099.686996:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875469181952256:12345-192.168.204.28@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788587099.687039:0:6706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:1.0:1788587099.687073:0:6706:0:(genops.c:1385:class_connect()) connect: client 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8, cookie 0xc1a730b05ab88fea 00002000:00100000:1.0:1788587099.687085:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8/ffff8bacbbc35800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788587099.687096:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788587099.687365:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788587099.687394:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc32800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587099.687478:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2358:x1875469181952256:12345-192.168.204.28@tcp:8:lhsmtool_posix.0 Request processed in 481us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.687487:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:2.0:1788587099.690028:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587099.690373:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181952384 00000100:00100000:1.0:1788587099.690403:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181952384 00000100:00100000:1.0:1788587099.690498:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:1.0:1788587099.690508:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:0:x1875469181952384:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788587099.691090:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587099.771865:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:0:x1875469181952384:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 81328us (81816us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788587099.771880:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000001:00080000:3.0:1788587099.774557:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1788587099.774574:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000100:00100000:2.0:1788587099.775133:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.775259:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181952640 00000100:00100000:0.0:1788587099.775269:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181952640 00000100:00100000:0.0:1788587099.775444:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:0.0:1788587099.775454:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:10460:x1875469181952640:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587099.775708:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:10460:x1875469181952640:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 253us (578us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788587099.775717:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788587099.778126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.778264:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181952896 00000100:00100000:3.0:1788587099.778275:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181952896 00000100:00100000:3.0:1788587099.778344:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:3.0:1788587099.778354:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:10460:x1875469181952896:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587099.778475:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:10460:x1875469181952896:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 122us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.778482:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:2.0:1788587099.780627:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.780710:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181953024 00000100:00100000:3.0:1788587099.780731:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181953024 00000100:00100000:3.0:1788587099.780785:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:3.0:1788587099.780795:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:10460:x1875469181953024:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587099.780815:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587099.780837:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88ff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c282a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.780940:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88ff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.780955:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.780966:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587099.781000:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587099.781018:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88ff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.781042:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab88ff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c282a expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.781060:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88ff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c282a expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.781069:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:3.0:1788587099.781072:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788587099.781076:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050200, rc 0) 00000100:00100000:3.0:1788587099.781124:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10460:x1875469181953024:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 330us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.781136:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:3.0:1788587099.784041:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587099.784141:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181953152 00000100:00100000:1.0:1788587099.784152:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181953152 00000100:00100000:1.0:1788587099.784216:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:1.0:1788587099.784226:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181953152:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587099.784244:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587099.784268:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2831 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587099.784295:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac5b, blocks: 0x1 00010000:00010000:1.0:1788587099.784314:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1788587099.784494:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587099.784504:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.784530:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.784545:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52bc00, rc 0) 00000100:00100000:1.0:1788587099.784604:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181953152:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 378us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.784627:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:3.0:1788587099.787393:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.787551:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181953408 00000100:00100000:0.0:1788587099.787561:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181953408 00000100:00100000:0.0:1788587099.787621:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:0.0:1788587099.787631:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10460:x1875469181953408:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587099.787754:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10460:x1875469181953408:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 125us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.787762:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:2.0:1788587099.790266:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.790511:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181953536 00000100:00100000:3.0:1788587099.790521:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181953536 00000100:00100000:3.0:1788587099.790578:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:3.0:1788587099.790588:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:10460:x1875469181953536:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587099.790604:0:10779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587099.790624:0:10779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2838 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.790655:0:10779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.790665:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587099.790669:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587099.790674:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.790708:0:10779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.790723:0:10779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 7 pid: 6706 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.790738:0:10779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10779:1875469208192384:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587099.790840:0:10779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb44fd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.793815:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587099.793961:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181953664 00000100:00100000:1.0:1788587099.793970:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181953664 00010000:00010000:1.0:1788587099.794012:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 8 pid: 6706 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.794054:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:1.0:1788587099.794064:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88341c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181953664:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587099.794078:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587099.794100:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 8 pid: 6706 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.794113:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 8 pid: 6706 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.794138:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587099.794142:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587099.794151:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 8 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.794161:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 8 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.794207:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 8 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.794238:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc899f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875469208192512:192.168.204.28@tcp:105: 00000100:00100000:1.0:1788587099.794306:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac853af300 going to sleep for 11 seconds 00010000:00010000:3.0:1788587099.800628:0:10779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf2b1949/0xc1a730b05ab88fff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2831 expref: 8 pid: 6706 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.800656:0:10779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10779:1875469208192384:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587099.800697:0:10779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.800714:0:10779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051c00, rc 0) 00000100:00100000:3.0:1788587099.800775:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:10460:x1875469181953536:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 10189us (10519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.800783:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1788587099.801081:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc899f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875469208192512:192.168.204.28@tcp:105: 00010000:00010000:1.0:1788587099.801094:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587099.801128:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88341c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181953664:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 7066us (7324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587099.801137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:2.0:1788587099.804126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.804206:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181953792 00000100:00100000:3.0:1788587099.804215:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181953792 00002000:00100000:3.0:1788587099.804260:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8bacb4d82d80 x1875469181953792/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:415/0 lens 504/0 e 0 to 0 dl 1788587110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587099.804271:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacb4d82d80 with x1875469181953792 ext(0->8) 00002000:00010000:3.0:1788587099.804276:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacb4d82d80 00000100:00100000:3.0:1788587099.804308:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:3.0:1788587099.804317:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181953792:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788587099.805132:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2360:x1875469181953792:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 812us (1012us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788587099.805141:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00002000:00100000:3.0:1788587099.805151:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8bacb4d82d80 x1875469181953792/t4294967302(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:415/0 lens 504/448 e 0 to 0 dl 1788587110 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587099.805166:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacb4d82d80 with x1875469181953792 ext(0->8) 00002000:00010000:3.0:1788587099.805171:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacb4d82d80 00000100:00100000:2.0:1788587099.807882:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.808083:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181953920 00000100:00100000:3.0:1788587099.808093:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181953920 00000100:00100000:3.0:1788587099.808146:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:3.0:1788587099.808156:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10460:x1875469181953920:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1788587099.843422:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788587099.875118:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788587099.875178:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1788587099.875195:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788587099.875222:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788587099.875231:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bacb58be9c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788587099.875236:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bacc1815700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bacb58be000 00000020:00080000:2.0:1788587099.875240:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bacc1815300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bac83005800 00000020:00080000:2.0:1788587099.875540:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788587099.875650:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788587099.875862:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:10460:x1875469181953920:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 67679us (67962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.875874:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:0.0:1788587099.875987:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208192640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788587099.876052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587099.876178:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208192640 00000100:00100000:3.0:1788587099.876187:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208192640 00000100:00100000:3.0:1788587099.876236:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587099.876247:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208192640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788587099.876272:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788587099.876304:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9bac58, atime: 0x6a9bac58, ctime: 0x6a9bac58, blocks: 0x1 00010000:00010000:3.0:1788587099.876312:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.876497:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788587099.876503:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587099.876511:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.876528:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.876558:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.876566:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.876590:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587099.877111:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875469208192640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 864us (1057us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788587099.877119:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788587099.877262:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587099.877274:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.877283:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587099.877287:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.877298:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.877327:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.877335:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8900d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.877354:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587099.877356:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587099.877358:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788587099.877457:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bacb4d83800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788587099.877465:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208192640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788587099.881155:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208192768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788587099.881242:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.881475:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208192768 00000100:00100000:2.0:1788587099.881485:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208192768 00000100:00100000:2.0:1788587099.881551:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587099.881562:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208192768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788587099.881766:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788587099.881770:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788587099 00002000:00010000:2.0:1788587099.881772:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587099.881774:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788587099 -> 1788587099 00002000:00010000:2.0:1788587099.881777:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788587099.881823:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875469208192768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 262us (580us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788587099.881876:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587099.882527:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.882606:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181954048 00000100:00100000:3.0:1788587099.882613:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181954048 00000100:00100000:3.0:1788587099.882658:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:3.0:1788587099.882667:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181954048:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788587099.883339:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bacaf2b4a80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788587099.883350:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208192768:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1788587099.926864:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788587099.926884:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788587099.927503:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181954048:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 44831us (44973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.927515:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:2.0:1788587099.931092:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.931262:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181954304 00000100:00100000:0.0:1788587099.931273:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181954304 00000100:00100000:0.0:1788587099.931428:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:0.0:1788587099.931439:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:10460:x1875469181954304:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587099.931509:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587099.931536:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab88ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c282a expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.931557:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:0.0:1788587099.931562:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587099.931596:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.931610:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.931619:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587099.931953:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afcbb326 reply state 000000006c68bd5a transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.931963:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587099.932065:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:10460:x1875469181954304:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 627us (983us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1788587099.932072:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00010000:00010000:3.0:1788587099.933791:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.933809:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.933837:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.933877:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587099.933883:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.933895:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.933918:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:3.0:1788587099.933921:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587099.933926:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.933933:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89014 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.935430:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587099.935561:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181954432 00000100:00100000:1.0:1788587099.935573:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181954432 00000100:00100000:1.0:1788587099.935635:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:1.0:1788587099.935656:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181954432:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788587099.935939:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788587099.935942:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788587099 -> 1788587098 00002000:00010000:1.0:1788587099.935945:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788587096 00002000:00010000:1.0:1788587099.935948:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788587099 -> 1788587098 00002000:00010000:1.0:1788587099.935950:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788587099.936006:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181954432:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 362us (584us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788587099.936015:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:1.0:1788587099.938546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587099.939101:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181954688 00000100:00100000:2.0:1788587099.939111:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181954688 00000100:00100000:1.0:1788587099.939236:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:1.0:1788587099.939249:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:10460:x1875469181954688:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788587099.939343:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.939361:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.939372:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.939416:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.939431:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 13 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.939447:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc898a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208192896:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587099.939552:0:7662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac87ce4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.942547:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc898a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208192896:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587099.942577:0:7662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.944757:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.945013:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181954816 00000100:00100000:3.0:1788587099.945022:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181954816 00010000:00010000:3.0:1788587099.945061:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 14 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.945096:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1788587099.945106:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469181954816:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587099.945134:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587099.945141:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 14 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.945153:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 14 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.945176:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab88fd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c281c expref: 14 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.945192:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:3.0:1788587099.945197:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.945206:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.945212:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.945244:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587099.945302:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2362:x1875469181954816:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 197us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.945308:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00010000:00010000:1.0:1788587099.945552:0:7662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945561:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945592:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945599:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945617:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945623:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587099.945627:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945635:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945722:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:1.0:1788587099.945725:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788587099.945730:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.945737:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8901b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.945797:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:10460:x1875469181954688:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 6550us (7260us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788587099.945805:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:1.0:1788587099.949878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587099.949983:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181954944 00000100:00100000:2.0:1788587099.949996:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181954944 00000100:00100000:2.0:1788587099.950069:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:2.0:1788587099.950081:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469181954944:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788587099.950139:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.950164:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.950183:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788587099.950187:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587099.950193:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.950232:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 7 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.950248:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 7 pid: 10779 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.950263:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875469208193024:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587099.950441:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.954151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.954259:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181955072 00000100:00100000:0.0:1788587099.954270:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181955072 00010000:00010000:0.0:1788587099.954330:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 8 pid: 10779 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.954376:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:0.0:1788587099.954386:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181955072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587099.954427:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587099.954455:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 8 pid: 10779 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.954471:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 8 pid: 10779 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.954501:0:8474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587099.954505:0:8474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587099.954512:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.954523:0:8474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.954545:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587099.954605:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181955072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 220us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.954614:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00010000:00010000:2.0:1788587099.955041:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000158d6762/0xc1a730b05ab89006 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2838 expref: 7 pid: 10779 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.955057:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875469208193024:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587099.955078:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955089:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955097:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955125:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955133:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955141:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955148:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587099.955152:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955177:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955190:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.955198:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89022 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.955267:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181954944:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 5189us (5428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587099.955275:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:3.0:1788587099.962628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587099.962744:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181955328 00000100:00100000:2.0:1788587099.962756:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181955328 00000100:00100000:2.0:1788587099.962819:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:2.0:1788587099.962829:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:10460:x1875469181955328:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587099.962944:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.962963:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.962975:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.963192:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.963216:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.963225:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.963260:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.963275:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 13 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.963290:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208193152:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587099.963526:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788587099.967182:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587099.967276:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181955456 00000100:00100000:3.0:1788587099.967290:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181955456 00010000:00010000:3.0:1788587099.967340:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 14 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587099.967425:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1788587099.967435:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469181955456:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587099.967453:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587099.967460:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 14 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.967476:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 14 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.967500:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:3.0:1788587099.967506:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.967517:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.967525:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587099.967545:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587099.967617:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469181955456:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.967625:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00010000:00010000:2.0:1788587099.968920:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab88fe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2823 expref: 13 pid: 5852 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.968943:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208193152:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587099.968968:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.968977:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.968984:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587099.969226:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1788587099.969438:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1788587099.969484:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788587099.969578:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208193280:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788587099.969839:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.970471:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.971509:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208193280 00000100:00100000:3.0:1788587099.971521:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208193280 00000100:00100000:3.0:1788587099.971663:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587099.971674:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875469208193280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587099.971813:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875469208193280:12345-0@lo:1000:mdt00_002.0 Request processed in 141us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587099.971820:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587099.971925:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788587099.971932:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bacaf2b4a80, transno 4294967303 00000100:00100000:2.0:1788587099.971946:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208193280:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788587099.973084:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788587099.973233:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208193408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788587099.973286:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587099.973840:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587099.974008:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208193408 00000100:00100000:3.0:1788587099.974017:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208193408 00000100:00100000:3.0:1788587099.974061:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587099.974070:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875469208193408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587099.974486:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875469208193408:12345-0@lo:1000:mdt00_002.0 Request processed in 416us (1198us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788587099.974495:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587099.974791:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf499180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208193408:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788587099.974835:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.974870:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.974879:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.974885:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587099.974890:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.974899:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975029:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8bac90439d00) 00010000:00010000:2.0:1788587099.975051:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587099.975058:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975066:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89030 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975112:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975120:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975125:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975130:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587099.975134:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975139:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975147:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc400) 00010000:00010000:2.0:1788587099.975149:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587099.975152:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975158:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab88f5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975258:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975283:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975292:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975418:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.975435:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 16 pid: 5851 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.975449:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf499500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208193536:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587099.975586:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587099.980227:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf499500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208193536:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587099.980259:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587099.981726:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587099.982080:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181955584 00000100:00100000:0.0:1788587099.982091:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181955584 00010000:00010000:0.0:1788587099.982133:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 17 pid: 5851 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587099.982183:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:0.0:1788587099.982194:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:2362:x1875469181955584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587099.982226:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587099.982234:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 17 pid: 5851 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.982248:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 17 pid: 5851 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.982275:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab88f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2807 expref: 17 pid: 5851 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.982291:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc400) 00010000:00010000:0.0:1788587099.982296:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.982307:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.982328:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.982366:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587099.982443:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:2362:x1875469181955584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 250us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587099.982451:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00010000:00010000:2.0:1788587099.982561:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982570:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982583:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982590:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982605:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982610:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587099.982615:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982623:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982633:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc400) 00010000:00010000:2.0:1788587099.982636:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587099.982639:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982646:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89037 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982657:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982663:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982669:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982675:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587099.982677:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982693:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982702:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc400) 00010000:00010000:2.0:1788587099.982704:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587099.982707:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587099.982712:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89029 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587099.982982:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:10460:x1875469181955328:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 20152us (20362us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788587099.982989:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000020:00080000:2.0:1788587099.982993:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788587099.983358:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587099.983363:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587099.983415:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788587099.983423:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587099.986979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587099.987118:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181955840 00000100:00100000:1.0:1788587099.987130:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181955840 00000100:00100000:1.0:1788587099.987198:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:1.0:1788587099.987208:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:10460:x1875469181955840:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788587099.988494:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788587099.988627:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788587099.988691:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.988709:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.988722:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.988731:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.988738:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.988744:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587099.988768:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788587099.989136:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:10460:x1875469181955840:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1925us (2163us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788587099.989146:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000020:00080000:1.0:1788587099.989152:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788587099.989431:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587099.989443:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.989451:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ba00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587099.989457:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.989466:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.989484:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8baca1025f00) 00010000:00010000:0.0:1788587099.989487:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587099.989492:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.989498:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab8903e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587099.989520:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587099.989522:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587099.989524:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587100.867564:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587101.199626:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.199671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.199716:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.199743:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.199775:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.199804:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181956352 00000100:00100000:1.0:1788587101.199813:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181956352 00000100:00100000:2.0:1788587101.199838:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181956224 00000100:00100000:2.0:1788587101.199866:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181956224 00000100:00100000:2.0:1788587101.199923:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:3.0:1788587101.199946:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181956096 00000100:00100000:3.0:1788587101.199951:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181956096 00000100:00100000:3.0:1788587101.199983:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181956480 00000100:00100000:3.0:1788587101.199986:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181956480 00000100:00100000:3.0:1788587101.200009:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:3.0:1788587101.200017:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:2362:x1875469181956096:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587101.200090:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:2362:x1875469181956096:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 73us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587101.200097:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:2.0:1788587101.200118:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181956224:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587101.200130:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00100000:3.0:1788587101.200148:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181956480:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587101.200225:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181956224:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 294us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587101.200232:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:3.0:1788587101.200286:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181956480:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 147us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587101.200292:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00080000:3.0:1788587101.200340:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587101.200345:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587101.200354:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587101.200426:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181955968 00000100:00100000:0.0:1788587101.200430:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181955968 00000100:00100000:0.0:1788587101.200465:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 293 00000100:00100000:0.0:1788587101.200473:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181955968:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587101.200498:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181955968:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 27us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587101.200504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 293 00000100:00100000:3.0:1788587101.205876:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:3.0:1788587101.205901:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181956352:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587101.205990:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181956352:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 102us (6318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587101.205997:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000040:00080000:2.0:1788587101.458576:0:12078:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587101.458587:0:12078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587101.458628:0:12078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788587101.458634:0:12078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587101.572033:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587101.572200:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181956736 00000100:00100000:3.0:1788587101.572210:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181956736 00000100:00100000:3.0:1788587101.572317:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:3.0:1788587101.572328:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:10477:x1875469181956736:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587101.572350:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587101.572372:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89045 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c283f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.572486:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab8904c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.572500:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab8904c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.572512:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab8904c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587101.572523:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788587101.572659:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89045 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c283f expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.572675:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab8904c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c283f expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.572696:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587101.572698:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587101.572702:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050a00, rc 0) 00000100:00100000:3.0:1788587101.572762:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:10477:x1875469181956736:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 436us (741us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788587101.572769:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:1.0:1788587101.597698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587101.598233:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181956864 00000100:00100000:0.0:1788587101.598250:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181956864 00000100:00100000:0.0:1788587101.598326:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:0.0:1788587101.598338:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:10477:x1875469181956864:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:0.0:1788587101.598437:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598455:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598466:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598482:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598489:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598496:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598744:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598755:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598762:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587101.598807:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598830:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598836:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598870:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598877:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587101.598882:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598889:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598902:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587101.598905:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587101.598909:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598915:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8905a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598925:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598931:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598936:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598947:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587101.598951:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598957:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598965:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac90439200) 00010000:00010000:0.0:1788587101.598967:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587101.598971:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598976:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598991:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.598998:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.599004:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.599010:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587101.599013:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.599019:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.599035:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac90439e00) 00010000:00010000:0.0:1788587101.599037:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587101.599039:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.599044:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587101.599122:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:10477:x1875469181956864:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 784us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587101.599129:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:3.0:1788587101.654637:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.656175:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181957120 00000100:00100000:1.0:1788587101.656190:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181957120 00000100:00100000:1.0:1788587101.656263:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:1.0:1788587101.656273:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:10480:x1875469181957120:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587101.656294:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587101.656316:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab8906f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2846 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656401:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656418:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656440:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656454:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656461:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656467:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656743:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656752:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656766:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587101.656776:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788587101.656904:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656912:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656932:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656938:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587101.656942:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656950:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656962:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:1.0:1788587101.656965:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587101.656971:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656978:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656989:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.656995:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657009:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657014:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587101.657017:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657024:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657034:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8baca1025700) 00010000:00010000:1.0:1788587101.657036:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587101.657040:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657045:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8907d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657098:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab8906f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657113:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.657121:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587101.657123:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587101.657125:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52a800, rc 0) 00000100:00100000:1.0:1788587101.657199:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10480:x1875469181957120:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 927us (2573us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788587101.657216:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:0.0:1788587101.663551:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587101.663627:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181957248 00000100:00100000:3.0:1788587101.663638:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181957248 00000100:00100000:3.0:1788587101.663693:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:3.0:1788587101.663703:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10480:x1875469181957248:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1788587101.663771:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663788:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663800:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663829:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663837:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663868:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663890:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587101.663894:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663902:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663914:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587101.663917:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587101.663922:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.663928:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587101.663996:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10480:x1875469181957248:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 294us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587101.664004:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:3.0:1788587101.668754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587101.673104:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181957504 00000100:00100000:0.0:1788587101.673361:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181957504 00000100:00100000:0.0:1788587101.673487:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:0.0:1788587101.673498:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84662050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10480:x1875469181957504:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587101.673763:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84662050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:10480:x1875469181957504:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 266us (5018us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788587101.673772:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1788587101.707261:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.708461:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181957760 00000100:00100000:1.0:1788587101.708474:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181957760 00000100:00100000:1.0:1788587101.708532:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:1.0:1788587101.708544:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:9999:x1875469181957760:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587101.708568:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587101.708589:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89099 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c284d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.708691:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.708707:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.708716:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.708749:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.708762:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 23 pid: 5852 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587101.708775:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb58c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208193664:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587101.708887:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831f03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587101.713520:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.713578:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181957888 00000100:00100000:1.0:1788587101.713588:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181957888 00010000:00010000:1.0:1788587101.713629:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 24 pid: 5852 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587101.713675:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:1.0:1788587101.713685:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:2362:x1875469181957888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587101.713702:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587101.713710:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 24 pid: 5852 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.713725:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 24 pid: 5852 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.713751:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587101.713756:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.713766:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.713774:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.713795:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587101.713868:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:2362:x1875469181957888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587101.713875:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00010000:00010000:3.0:1788587101.716558:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab89084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2846 expref: 23 pid: 5852 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587101.716587:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb58c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208193664:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587101.716690:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.716701:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.716721:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587101.716742:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788587101.718304:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89099 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.718333:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.718343:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587101.718346:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587101.718350:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52aa00, rc 0) 00000100:00100000:3.0:1788587101.718428:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:9999:x1875469181957760:12345-192.168.204.28@tcp:101:bash.0 Request processed in 9885us (11180us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788587101.718438:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:3.0:1788587101.727698:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587101.727871:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181958144 00000100:00100000:0.0:1788587101.727881:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181958144 00000100:00100000:0.0:1788587101.727944:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00100000:0.0:1788587101.727956:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:9999:x1875469181958144:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:0.0:1788587101.728287:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.728305:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.728331:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587101.728399:0:7662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788587101.728426:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e468126a reply state 0000000024c224ea transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587101.728435:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788587101.728484:0:7662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788587101.728679:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:9999:x1875469181958144:12345-192.168.204.28@tcp:36:bash.0 Request processed in 725us (992us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788587101.728687:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 89 00000020:00080000:0.0:1788587101.728693:0:7662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788587101.733282:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:2.0:1788587101.733362:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587101.733395:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587101.733402:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587101.733409:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587101.733414:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587101.733422:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587101.733439:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587101.733443:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587101.733447:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587101.733454:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab890ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587101.733696:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181958272 00000100:00100000:1.0:1788587101.733713:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181958272 00000100:00100000:1.0:1788587101.733771:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:1.0:1788587101.733782:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:9999:x1875469181958272:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587101.733805:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587101.733823:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab890b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2854 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.733907:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab890b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2854 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.733920:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab890b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2854 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.733940:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587101.733943:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587101.733946:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52b600, rc 0) 00000100:00100000:1.0:1788587101.734008:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:9999:x1875469181958272:12345-192.168.204.28@tcp:101:bash.0 Request processed in 228us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587101.734015:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:1.0:1788587101.739939:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587101.740861:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181958400 00000100:00100000:3.0:1788587101.740874:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181958400 00000100:00100000:3.0:1788587101.740936:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1788587101.740947:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:9999:x1875469181958400:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587101.740965:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587101.740989:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c285b expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587101.741021:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bac5a, atime: 0x6a9bac58, ctime: 0x6a9bac5a, blocks: 0xb 00010000:00010000:3.0:1788587101.741065:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1788587101.741069:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587101.741077:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.741097:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587101.741110:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051400, rc 0) 00000100:00100000:3.0:1788587101.741242:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:9999:x1875469181958400:12345-192.168.204.28@tcp:101:bash.0 Request processed in 296us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587101.741249:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:0.0:1788587101.750707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587101.753219:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181958528 00000100:00100000:3.0:1788587101.753235:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181958528 00002000:00010000:3.0:1788587101.753285:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788587101.753290:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacaf2b7480 with x1875469181958528 ext(0->18446744073709551615) 00002000:00010000:3.0:1788587101.753302:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacaf2b7480. 00000100:00100000:3.0:1788587101.753351:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1788587101.753362:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181958528:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1788587101.753658:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788587101.753662:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788587098 -> 1788587101 00002000:00010000:3.0:1788587101.753665:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788587096 -> 1788587096 00002000:00010000:3.0:1788587101.753667:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788587098 -> 1788587101 00002000:00010000:3.0:1788587101.753669:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788587101.753738:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181958528:12345-192.168.204.28@tcp:10:bash.0 Request processed in 378us (3042us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788587101.753763:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00002000:00010000:3.0:1788587101.753768:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788587101.753771:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacaf2b7480 with x1875469181958528 ext(0->18446744073709551615) 00002000:00010000:3.0:1788587101.753776:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacaf2b7480. 00000001:00080000:1.0:1788587101.776024:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788587101.776045:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788587101.874915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587101.875069:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181958656 00000100:00100000:0.0:1788587101.875084:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181958656 00000100:00100000:0.0:1788587101.875158:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:0.0:1788587101.875168:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:10494:x1875469181958656:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:0.0:1788587101.875241:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875259:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875273:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875302:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875324:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875331:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875596:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875605:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875613:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587101.875653:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875665:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875673:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875680:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875687:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587101.875692:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875699:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875717:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587101.875720:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587101.875724:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875731:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab890c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875744:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875749:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875754:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875759:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587101.875762:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875769:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875774:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac90439200) 00010000:00010000:0.0:1788587101.875776:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587101.875779:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875785:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab890ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875809:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875816:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875821:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875826:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587101.875829:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875834:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875893:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:0.0:1788587101.875896:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587101.875899:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.875905:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587101.875987:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:10494:x1875469181958656:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 819us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587101.875995:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 91 00010000:00010000:0.0:1788587101.892963:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587101.942202:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.948252:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181958912 00000100:00100000:1.0:1788587101.948270:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181958912 00000100:00100000:1.0:1788587101.948596:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:1.0:1788587101.948607:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:10497:x1875469181958912:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587101.948628:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587101.948666:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab890d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2862 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.948745:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.948760:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.948771:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.948785:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.948792:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.948799:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949091:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab890ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949101:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab890ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949109:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab890ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587101.949118:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788587101.949787:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949809:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949816:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949822:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587101.949826:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949834:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949871:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:1.0:1788587101.949874:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587101.949880:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949886:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab890df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949899:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949904:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949910:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949914:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587101.949922:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949928:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949935:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8baca1025700) 00010000:00010000:1.0:1788587101.949938:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587101.949940:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949946:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab890e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.949991:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab890d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2862 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.950006:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab890ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2862 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.950012:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587101.950015:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587101.950017:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52ba00, rc 0) 00000100:00100000:1.0:1788587101.951752:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:10497:x1875469181958912:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3137us (9550us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788587101.951765:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:2.0:1788587101.956602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587101.956714:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181959040 00000100:00100000:0.0:1788587101.956724:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181959040 00000100:00100000:0.0:1788587101.956796:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:0.0:1788587101.956806:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:10497:x1875469181959040:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:0.0:1788587101.957974:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.957998:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.958008:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.958047:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.958063:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 29 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587101.959239:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208193792:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587101.959586:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587101.964015:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208193792:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587101.964052:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587101.964598:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587101.965595:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181959296 00000100:00100000:1.0:1788587101.965608:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181959296 00000100:00100000:2.0:1788587101.965830:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:2.0:1788587101.965863:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:5602:x1875469181959296:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587101.966276:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:5602:x1875469181959296:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 435us (1680us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788587101.966284:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1788587101.968667:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587101.968775:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181959424 00000100:00100000:0.0:1788587101.968785:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181959424 00010000:00010000:0.0:1788587101.968833:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 31 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587101.968913:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:0.0:1788587101.968935:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:2362:x1875469181959424:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587101.968953:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587101.968960:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 31 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.968975:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 31 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.968999:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab890a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c284d expref: 31 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.969016:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:0.0:1788587101.969021:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.969030:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.969038:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587101.969063:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587101.969129:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:2362:x1875469181959424:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 196us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587101.969137:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00010000:00010000:1.0:1788587101.969299:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969318:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969363:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969379:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969385:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969391:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587101.969395:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969402:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969411:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587101.969414:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587101.969418:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587101.969424:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab890fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587101.969468:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:10497:x1875469181959040:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 12663us (12877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587101.969476:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:3.0:1788587101.972414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587101.973681:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181959680 00000100:00100000:0.0:1788587101.973695:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181959680 00000100:00100000:0.0:1788587101.973770:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:0.0:1788587101.973781:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:10497:x1875469181959680:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587101.974155:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:10497:x1875469181959680:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 375us (1831us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788587101.974163:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:2.0:1788587102.077031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.077244:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181959936 00000100:00100000:3.0:1788587102.077256:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181959936 00000100:00100000:3.0:1788587102.077446:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:3.0:1788587102.077458:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+30:10508:x1875469181959936:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:3.0:1788587102.077486:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587102.077509:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2869 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.077585:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.077601:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.077615:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.077631:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.077658:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.077666:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078003:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89117 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078014:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078021:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587102.078032:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788587102.078149:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078156:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078163:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078168:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587102.078173:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078181:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078201:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587102.078204:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587102.078208:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078215:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078228:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078234:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078240:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078245:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587102.078248:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078253:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078260:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac987bc100) 00010000:00010000:3.0:1788587102.078263:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587102.078265:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078281:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078334:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2869 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078350:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2869 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.078357:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587102.078358:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587102.078361:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:3.0:1788587102.078441:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:10508:x1875469181959936:12345-192.168.204.28@tcp:101:cat.0 Request processed in 986us (1420us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788587102.078449:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:3.0:1788587102.084270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.085983:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181960192 00000100:00100000:0.0:1788587102.085999:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181960192 00000100:00100000:0.0:1788587102.086075:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:0.0:1788587102.086085:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:10508:x1875469181960192:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:0.0:1788587102.086922:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:10508:x1875469181960192:12345-192.168.204.28@tcp:35:cat.0 Request processed in 833us (2656us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788587102.086932:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:2.0:1788587102.107758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.108298:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181960448 00000100:00100000:3.0:1788587102.108310:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181960448 00000100:00100000:3.0:1788587102.108389:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:3.0:1788587102.108400:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:10509:x1875469181960448:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:3.0:1788587102.108458:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788587102.108486:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2869 expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108507:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab890ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2862 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108520:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab890b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2854 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108543:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587102.108554:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587102.108574:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108588:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108598:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108615:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108622:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108629:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108934:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108945:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.108952:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587102.109877:0:7662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788587102.109889:0:7662:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424314045884ns, next at 425314041904ns, rc = 0 00010000:00010000:2.0:1788587102.113577:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113602:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113615:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113624:0:7662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113631:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113637:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113704:0:7662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587102.113730:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113737:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113743:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113748:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587102.113753:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113761:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113788:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:2.0:1788587102.113791:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788587102.113796:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113803:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89133 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113828:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113834:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113869:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113875:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587102.113878:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113883:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113890:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587102.113892:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587102.113895:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.113901:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89125 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587102.113939:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049684fe0 reply state 00000000d4d47650 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.113948:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587102.114046:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:10509:x1875469181960448:12345-192.168.204.28@tcp:36:rm.0 Request processed in 5643us (6293us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788587102.114055:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 95 00010000:00010000:0.0:1788587102.120925:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587102.120941:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.120956:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587102.120961:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.120973:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.120993:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587102.120997:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587102.121002:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.121009:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8913a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.121058:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587102.121060:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587102.121063:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587102.121250:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.121261:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.121277:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.121283:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587102.121287:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.121294:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.121305:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac987bc100) 00010000:00010000:3.0:1788587102.121307:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587102.121311:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.121316:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab8912c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.172937:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587102.174873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181960704 00000100:00100000:1.0:1788587102.174891:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181960704 00000100:00100000:1.0:1788587102.174985:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:1.0:1788587102.174998:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:10515:x1875469181960704:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587102.175025:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587102.175048:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89141 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2870 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.175560:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.175578:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.175591:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.175607:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.175615:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.175622:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587102.176201:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788587102.176396:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176407:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176422:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176465:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176473:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176480:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176486:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587102.176491:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176498:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176510:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:1.0:1788587102.176513:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587102.176517:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176524:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89148 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587102.176538:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b1deed6 reply state 0000000078fc7f1c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587102.176547:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788587102.176587:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89141 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176602:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.176610:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587102.176612:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587102.176615:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52b600, rc 0) 00000100:00100000:1.0:1788587102.176696:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:10515:x1875469181960704:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1701us (3770us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788587102.176705:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 96 00010000:00010000:3.0:1788587102.179887:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.179904:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.179912:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.179935:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587102.179940:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.179948:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.179966:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8baca1025700) 00010000:00010000:3.0:1788587102.179969:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587102.179974:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.179980:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8914f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.182585:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.182685:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181960832 00000100:00100000:0.0:1788587102.182695:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181960832 00000100:00100000:0.0:1788587102.182756:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:0.0:1788587102.182766:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469181960832:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1788587102.182784:0:10779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587102.182806:0:10779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2877 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587102.182833:0:10779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587102.182895:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1788587102.182901:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587102.182910:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 6 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.182931:0:10779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 6 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.182944:0:10779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98200, rc 0) 00000100:00100000:0.0:1788587102.183020:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181960832:12345-192.168.204.28@tcp:101:bash.0 Request processed in 255us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587102.183028:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:2.0:1788587102.186956:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.187261:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181960960 00000100:00100000:3.0:1788587102.187270:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181960960 00000100:00100000:3.0:1788587102.187392:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1788587102.187403:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:10515:x1875469181960960:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587102.187421:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587102.187440:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c287e expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.187470:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.187478:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587102.187483:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587102.187500:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.187536:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.187549:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 7 pid: 10779 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.187563:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6706:1875469208193920:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587102.187657:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90347cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587102.193495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.193598:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181961088 00000100:00100000:2.0:1788587102.193607:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181961088 00010000:00010000:2.0:1788587102.193650:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 8 pid: 10779 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.193697:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:2.0:1788587102.193707:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88340c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181961088:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587102.193722:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587102.193747:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 8 pid: 10779 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.193761:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 8 pid: 10779 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.193787:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587102.193792:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587102.193816:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.193829:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.193835:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab89164 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2877 expref: 8 pid: 10779 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.193881:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6706:1875469208193920:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587102.193898:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.193910:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.193924:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051800, rc 0) 00000100:00100000:2.0:1788587102.193981:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf498a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875469208194048:192.168.204.28@tcp:105: 00000100:00100000:3.0:1788587102.193982:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:10515:x1875469181960960:12345-192.168.204.28@tcp:101:bash.0 Request processed in 6579us (7035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.193994:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:2.0:1788587102.194036:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587102.196886:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf498a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875469208194048:192.168.204.28@tcp:105: 00010000:00010000:1.0:1788587102.196913:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587102.196966:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88340c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181961088:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 3260us (3483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587102.196977:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:2.0:1788587102.199984:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.200078:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181961344 00000100:00100000:0.0:1788587102.200088:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181961344 00000100:00100000:0.0:1788587102.200165:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:0.0:1788587102.200176:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:10515:x1875469181961344:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1788587102.200675:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:10515:x1875469181961344:12345-192.168.204.28@tcp:35:bash.0 Request processed in 500us (699us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788587102.200683:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:3.0:1788587102.366085:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.366265:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181961472 00000100:00100000:0.0:1788587102.366276:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181961472 00000100:00100000:0.0:1788587102.366337:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:0.0:1788587102.366349:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:10531:x1875469181961472:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587102.366391:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587102.366424:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89172 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.366489:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.366505:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.366517:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587102.366552:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788587102.366555:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587102.366572:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.366607:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89172 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2885 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.366645:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2885 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.366654:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587102.366657:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587102.366661:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587102.366723:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:10531:x1875469181961472:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 377us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587102.366731:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:3.0:1788587102.376760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.376902:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181961728 00000100:00100000:2.0:1788587102.376914:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181961728 00000100:00100000:2.0:1788587102.377037:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:2.0:1788587102.377049:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:10531:x1875469181961728:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587102.377071:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587102.377093:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c288c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.377511:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.377526:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.377538:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587102.377570:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788587102.377706:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c288c expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.377728:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c288c expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.377736:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:2.0:1788587102.377739:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587102.377742:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4200, rc 0) 00000100:00100000:2.0:1788587102.377809:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:10531:x1875469181961728:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 763us (1060us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788587102.377817:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:2.0:1788587102.384172:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.384233:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.384276:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181961984 00000100:00100000:0.0:1788587102.384297:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181961984 00000100:00100000:0.0:1788587102.384376:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:0.0:1788587102.384387:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:10531:x1875469181961984:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587102.384412:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587102.384434:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2893 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.384569:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8919c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.384585:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8919c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.384596:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8919c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587102.384614:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788587102.384743:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2893 expref: 40 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.384762:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8919c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2893 expref: 39 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.384770:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:0.0:1788587102.384773:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587102.384776:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98000, rc 0) 00000100:00100000:0.0:1788587102.384899:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:10531:x1875469181961984:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 513us (737us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788587102.384906:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:3.0:1788587102.386487:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181962112 00000100:00100000:3.0:1788587102.386519:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181962112 00000100:00100000:3.0:1788587102.386658:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1788587102.386669:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:2359:x1875469181962112:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587102.386686:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587102.386711:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c288c expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.386731:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587102.386736:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587102.386794:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:2359:x1875469181962112:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 127us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.386801:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1788587102.391918:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.391967:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181962240 00000100:00100000:0.0:1788587102.391977:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181962240 00000100:00100000:0.0:1788587102.392033:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788587102.392044:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181962240:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:0.0:1788587102.393590:0:10779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.393620:0:10779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.393630:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587102.393635:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587102.393641:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.393696:0:10779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.393733:0:10779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 6 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587102.393752:0:10779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10779:1875469208194176:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587102.393896:0:10779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587102.398415:0:10779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10779:1875469208194176:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587102.398447:0:10779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.398492:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.398625:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181962368 00000100:00100000:3.0:1788587102.398634:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181962368 00002000:00100000:3.0:1788587102.398682:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8bacbf49b800 x1875469181962368/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:418/0 lens 504/0 e 0 to 0 dl 1788587113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587102.398692:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacbf49b800 with x1875469181962368 ext(0->8) 00010000:00010000:3.0:1788587102.398700:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 7 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.398713:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 7 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587102.398720:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacbf49b800 00000100:00100000:3.0:1788587102.398756:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1788587102.398766:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181962368:12345-192.168.204.28@tcp:4:lfs.0 00000100:00100000:3.0:1788587102.399393:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2361:x1875469181962368:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 625us (899us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788587102.399402:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00002000:00100000:3.0:1788587102.399420:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8bacbf49b800 x1875469181962368/t4294967302(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:418/0 lens 504/448 e 0 to 0 dl 1788587113 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587102.399428:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacbf49b800 with x1875469181962368 ext(0->8) 00010000:00010000:3.0:1788587102.399435:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 9 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.399448:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 9 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587102.399456:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacbf49b800 00000100:00100000:3.0:1788587102.402772:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587102.403069:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181962496 00000100:00100000:1.0:1788587102.403080:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181962496 00010000:00010000:1.0:1788587102.403126:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 9 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587102.403176:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:1.0:1788587102.403187:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2362:x1875469181962496:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587102.403203:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788587102.403223:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788587102.403240:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788587101 00002000:00010000:1.0:1788587102.403242:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788587102 00002000:00010000:1.0:1788587102.403244:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788587101 00010000:00010000:1.0:1788587102.403252:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 9 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.403266:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 9 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.403293:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009695cf8d/0xc1a730b05ab8916b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c287e expref: 9 pid: 6706 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.403314:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587102.403318:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587102.403325:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.403335:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.403379:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587102.403448:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181962496:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 262us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587102.403456:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00010000:00010000:3.0:1788587102.404188:0:10779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404202:0:10779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404236:0:10779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404244:0:10779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404278:0:10779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404286:0:10779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587102.404290:0:10779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404299:0:10779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404314:0:10779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.404331:0:10779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc91c615/0xc1a730b05ab891aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.404426:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181962240:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 12381us (12516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.404436:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:3.0:1788587102.409804:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.410110:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181962752 00000100:00100000:0.0:1788587102.410124:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181962752 00000100:00100000:0.0:1788587102.410252:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:0.0:1788587102.410263:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84663050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:10531:x1875469181962752:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:0.0:1788587102.410334:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8919c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2893 expref: 38 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587102.410655:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1788587102.410706:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788587102.411077:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1788587102.411136:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.411154:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.411184:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.411228:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.411248:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 42 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587102.411267:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208194304:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587102.411401:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587102.420255:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.420947:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208194304:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587102.420979:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.421644:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181962880 00000100:00100000:3.0:1788587102.421654:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181962880 00010000:00010000:3.0:1788587102.421695:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 43 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.421761:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:3.0:1788587102.421771:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:2362:x1875469181962880:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587102.421787:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587102.421795:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 43 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.421808:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 43 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.421832:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab89156 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2870 expref: 43 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.421889:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587102.421895:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.421905:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.421914:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.421948:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587102.422007:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+42:2362:x1875469181962880:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 237us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.422015:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00010000:00010000:2.0:1788587102.422307:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.422317:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587102.422474:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788587102.422688:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788587102.422802:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf498a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208194432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788587102.422942:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587102.422981:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587102.423631:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208194432 00000100:00100000:3.0:1788587102.423647:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208194432 00000100:00100000:3.0:1788587102.423726:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587102.423735:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208194432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587102.423828:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208194432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.423836:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587102.423997:0:5853:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788587102.424004:0:5853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788587102.424024:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bacb4d83800, transno 4294967301 00000100:00100000:0.0:1788587102.424047:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf498a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208194432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788587102.424560:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1788587102.424637:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208194560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788587102.424679:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587102.424703:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587102.424929:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208194560 00000100:00100000:1.0:1788587102.424936:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208194560 00000100:00100000:1.0:1788587102.424968:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587102.424986:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208194560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587102.425182:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1875469208194560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 198us (502us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788587102.425190:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587102.429731:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208194560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788587102.429840:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788587102.429955:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.429966:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.429974:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.429980:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587102.429985:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.429992:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.430009:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:0.0:1788587102.430012:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788587102.430016:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.430021:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587102.430260:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788587102.430381:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788587102.430393:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424634549013ns, next at 425634546910ns, rc = 0 00000001:00080000:0.0:1788587102.430399:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788587102.430438:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:0.0:1788587102.430441:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587102.430448:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8919c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2893 expref: 46 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587102.430592:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84663050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:10531:x1875469181962752:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 20329us (20799us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788587102.430601:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000020:00080000:0.0:1788587102.430607:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788587102.431138:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587102.435287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.435490:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181963008 00000100:00100000:2.0:1788587102.435501:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181963008 00000100:00100000:2.0:1788587102.435572:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:2.0:1788587102.435583:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:10531:x1875469181963008:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587102.435607:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587102.435631:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab891b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c289a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.435695:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab891b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c289a expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.435711:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab891b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c289a expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.435731:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.435734:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587102.435738:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5400, rc 0) 00000100:00100000:2.0:1788587102.435803:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+46:10531:x1875469181963008:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 221us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587102.435810:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:3.0:1788587102.442130:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.446880:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181963264 00000100:00100000:2.0:1788587102.446898:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181963264 00000100:00100000:2.0:1788587102.446973:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:2.0:1788587102.446984:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+46:10531:x1875469181963264:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587102.447454:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:10531:x1875469181963264:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 469us (5333us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788587102.447481:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1788587102.573538:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.573657:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181963392 00000100:00100000:0.0:1788587102.573667:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181963392 00000100:00100000:0.0:1788587102.573732:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:0.0:1788587102.573742:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:10541:x1875469181963392:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:0.0:1788587102.573814:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.573871:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.573883:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.573899:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.573906:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.573911:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574007:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574033:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574040:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587102.574084:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574097:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574104:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574111:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574116:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587102.574121:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574128:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574140:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587102.574143:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587102.574148:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574155:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab891bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574189:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574196:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574201:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574206:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587102.574209:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574215:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574227:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac90439400) 00010000:00010000:0.0:1788587102.574230:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587102.574233:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574240:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab891c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574260:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574266:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574272:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574283:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587102.574286:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574293:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574300:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:0.0:1788587102.574303:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587102.574306:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.574311:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab891cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587102.574620:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:10541:x1875469181963392:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 876us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587102.574629:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 101 00000100:00100000:1.0:1788587102.628758:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.628885:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181963648 00000100:00100000:2.0:1788587102.628896:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181963648 00000100:00100000:2.0:1788587102.628954:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:2.0:1788587102.628964:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:10544:x1875469181963648:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587102.628989:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587102.629011:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab891d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28a1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629091:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629125:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629493:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629515:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629523:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629530:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629662:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629689:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.629696:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587102.629707:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788587102.630002:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630011:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630018:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630023:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587102.630027:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630034:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630047:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587102.630051:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587102.630056:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630062:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab891db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630081:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630094:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630101:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630273:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587102.630277:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630284:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630293:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8baca0968500) 00010000:00010000:2.0:1788587102.630296:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587102.630299:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630304:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab891e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630348:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab891d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630443:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.630452:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.630455:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587102.630465:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4000, rc 0) 00000100:00100000:2.0:1788587102.630545:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:10544:x1875469181963648:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1582us (1799us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788587102.630554:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:3.0:1788587102.633889:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.634392:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181963776 00000100:00100000:2.0:1788587102.634403:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181963776 00000100:00100000:2.0:1788587102.634473:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:2.0:1788587102.634486:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:10544:x1875469181963776:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:2.0:1788587102.634555:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634572:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634584:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634611:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634618:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634625:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634630:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587102.634635:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634643:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634669:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.634671:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587102.634676:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.634683:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab891f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.634763:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:10544:x1875469181963776:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 279us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587102.634771:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 103 00000100:00100000:1.0:1788587102.640041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.640137:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181964032 00000100:00100000:0.0:1788587102.640148:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181964032 00000100:00100000:0.0:1788587102.640206:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:0.0:1788587102.640217:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:10544:x1875469181964032:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587102.640488:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:10544:x1875469181964032:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 273us (458us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788587102.640501:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:1.0:1788587102.734156:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.734382:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181964288 00000100:00100000:3.0:1788587102.734392:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181964288 00000100:00100000:3.0:1788587102.734459:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 104 00000100:00100000:3.0:1788587102.734470:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:10554:x1875469181964288:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587102.734495:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587102.734498:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788587102.734527:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2885 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.734549:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587102.734554:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587102.734569:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab891fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28a8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.734668:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.734683:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.734714:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.734751:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.734764:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 50 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.734779:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf949180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208194688:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587102.736814:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90347cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587102.742715:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587102.743009:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181964416 00000100:00100000:1.0:1788587102.743020:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181964416 00010000:00010000:1.0:1788587102.743072:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 51 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587102.743134:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1788587102.743145:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:2361:x1875469181964416:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587102.743162:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587102.743170:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 51 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.743185:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 51 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.743209:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:1.0:1788587102.743215:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.743241:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.743250:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587102.743273:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587102.743457:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab891e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a1 expref: 51 pid: 5852 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.743479:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf949180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208194688:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587102.743510:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.743520:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.743526:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587102.743544:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788587102.743714:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab891fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.743730:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.743746:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.743748:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587102.743751:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050e00, rc 0) 00000100:00100000:1.0:1788587102.744067:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:2361:x1875469181964416:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 922us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587102.744076:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:2.0:1788587102.744418:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:10554:x1875469181964288:12345-192.168.204.28@tcp:101:bash.0 Request processed in 9950us (10275us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788587102.744426:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 104 00000100:00100000:1.0:1788587102.762407:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.762492:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181964672 00000100:00100000:2.0:1788587102.762509:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181964672 00000100:00100000:2.0:1788587102.762570:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 105 00000100:00100000:2.0:1788587102.762580:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:10554:x1875469181964672:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1788587102.763039:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.763060:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.763073:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587102.764317:0:7662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788587102.764387:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3e893b6 reply state 00000000129d5212 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.764399:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587102.764533:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10554:x1875469181964672:12345-192.168.204.28@tcp:36:bash.0 Request processed in 1952us (2135us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788587102.764541:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 105 00000020:00080000:2.0:1788587102.764563:0:7662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788587102.773461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1788587102.773481:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.773494:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.773502:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.773508:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587102.773513:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.773520:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.773537:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:3.0:1788587102.773553:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587102.773559:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.773567:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.774403:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181964800 00000100:00100000:2.0:1788587102.774414:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181964800 00000100:00100000:2.0:1788587102.774486:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:2.0:1788587102.774497:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:10554:x1875469181964800:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587102.774521:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587102.774542:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8921a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28af expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.774642:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.774658:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.774668:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.774705:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.774720:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 53 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.774733:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208194816:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587102.774835:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587102.778321:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208194816:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587102.778362:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587102.787025:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.787436:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181964928 00000100:00100000:3.0:1788587102.787447:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181964928 00010000:00010000:3.0:1788587102.787489:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 54 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.787532:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:3.0:1788587102.787542:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:2362:x1875469181964928:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587102.787557:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587102.787564:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 54 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.787580:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 54 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.787603:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89205 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28a8 expref: 54 pid: 5850 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.787622:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:3.0:1788587102.787627:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.787637:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.787658:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.787697:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587102.787763:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:2362:x1875469181964928:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 222us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.787771:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00010000:00010000:2.0:1788587102.790004:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.790022:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587102.790076:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788587102.790081:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587102.790122:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.790164:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8921a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.790188:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.790198:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.790201:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587102.790205:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5e00, rc 0) 00000100:00100000:2.0:1788587102.790280:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:10554:x1875469181964800:12345-192.168.204.28@tcp:101:bash.0 Request processed in 15784us (16831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587102.790290:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 106 00000100:00100000:0.0:1788587102.798639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.798752:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181965184 00000100:00100000:2.0:1788587102.798763:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181965184 00000100:00100000:2.0:1788587102.798825:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:2.0:1788587102.798836:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:10554:x1875469181965184:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1788587102.799139:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10554:x1875469181965184:12345-192.168.204.28@tcp:35:bash.0 Request processed in 302us (508us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788587102.799157:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00010000:00010000:0.0:1788587102.915152:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587102.940989:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587102.944028:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181965312 00000100:00100000:0.0:1788587102.944045:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181965312 00000100:00100000:0.0:1788587102.944268:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:0.0:1788587102.944280:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:10560:x1875469181965312:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587102.944305:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587102.944326:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.944411:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab8922f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.944426:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab8922f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.944438:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab8922f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587102.944473:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788587102.944477:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587102.944493:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab8922f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.944516:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28b6 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.944550:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab8922f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28b6 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587102.944559:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587102.944574:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587102.944578:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788587102.944650:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10560:x1875469181965312:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 373us (3668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587102.944657:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 107 00000100:00100000:1.0:1788587102.952692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.952794:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181965440 00000100:00100000:3.0:1788587102.952805:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181965440 00000100:00100000:3.0:1788587102.952986:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 108 00000100:00100000:3.0:1788587102.952997:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10560:x1875469181965440:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587102.953017:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587102.953038:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28bd expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.953103:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.953185:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.953458:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.953477:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.953484:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.953506:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955609:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955626:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955638:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587102.955686:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788587102.955691:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587102.955711:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955723:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955732:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955739:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955745:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955751:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587102.955755:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955776:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955788:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587102.955791:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587102.955797:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955803:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8923d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955817:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955822:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955828:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955833:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587102.955836:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955861:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955870:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8bac987bc100) 00010000:00010000:3.0:1788587102.955872:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587102.955875:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955891:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955932:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955948:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.955955:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:3.0:1788587102.955957:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587102.955961:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587102.956099:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10560:x1875469181965440:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 3101us (3415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.956119:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 108 00000100:00100000:1.0:1788587102.969799:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.969916:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181965696 00000100:00100000:2.0:1788587102.969927:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181965696 00000100:00100000:2.0:1788587102.969995:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 109 00000100:00100000:2.0:1788587102.970007:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10560:x1875469181965696:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587102.970032:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587102.970061:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28c4 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.970185:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.970770:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.970781:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.970791:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.970834:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.970897:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 56 pid: 5850 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.970912:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208194944:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587102.971029:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.971038:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 56 pid: 5852 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.971047:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208195072:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587102.971069:0:7662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587102.971632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587102.974578:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181965824 00000100:00100000:2.0:1788587102.974594:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181965824 00010000:00010000:2.0:1788587102.974649:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 57 pid: 5850 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.974705:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:2.0:1788587102.974714:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:2361:x1875469181965824:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587102.974729:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587102.974736:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 57 pid: 5850 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.974749:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 57 pid: 5850 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.974773:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.974779:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.974789:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.974811:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587102.974921:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:2361:x1875469181965824:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 208us (3289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587102.974928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00010000:00010000:2.0:1788587102.996613:0:7662:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.28@tcp) returned -22 from blocking AST (req@00000000456a5d84 x1875469208194944) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 56 pid: 5850 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.996643:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab8924b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28bd expref: 56 pid: 5850 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587102.996663:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208194944:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587102.996681:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208195072:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587102.996706:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.996711:0:7662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.996720:0:7662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.996729:0:7662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587102.997938:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587102.998026:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181965952 00000100:00100000:3.0:1788587102.998035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181965952 00010000:00010000:3.0:1788587102.998076:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 56 pid: 5852 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587102.998126:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:3.0:1788587102.998136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88340850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:2362:x1875469181965952:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587102.998149:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587102.998155:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 56 pid: 5852 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.998189:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 56 pid: 5852 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.998222:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28af expref: 56 pid: 5852 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.998239:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:3.0:1788587102.998244:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.998252:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.998269:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587102.998294:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587102.998361:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88340850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:2362:x1875469181965952:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 227us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587102.998369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00010000:00010000:2.0:1788587102.998984:0:7662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.998994:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587102.999027:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788587102.999187:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 56 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.999224:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 55 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587102.999232:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587102.999235:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587102.999238:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4400, rc 0) 00000100:00100000:2.0:1788587102.999608:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10560:x1875469181965696:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 29602us (29820us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788587102.999617:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 109 00000100:00100000:1.0:1788587103.010940:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.011102:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181966208 00000100:00100000:2.0:1788587103.011121:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181966208 00000100:00100000:2.0:1788587103.011199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1788587103.011219:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10560:x1875469181966208:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:2.0:1788587103.011236:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587103.011271:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab891b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c289a expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.011293:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587103.011298:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587103.011364:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10560:x1875469181966208:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 149us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.011371:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00080000:3.0:1788587103.011837:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587103.017330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.017623:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181966336 00000100:00100000:3.0:1788587103.017635:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181966336 00000100:00100000:3.0:1788587103.017698:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 110 00000100:00100000:3.0:1788587103.017710:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10560:x1875469181966336:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:3.0:1788587103.017818:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.017875:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.017888:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587103.018079:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788587103.018489:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10560:x1875469181966336:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 780us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.018498:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 110 00000100:00100000:0.0:1788587103.020967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587103.021065:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181966464 00000100:00100000:1.0:1788587103.021075:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181966464 00000100:00100000:2.0:1788587103.021372:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 111 00000100:00100000:2.0:1788587103.021385:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:10560:x1875469181966464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587103.021406:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587103.021428:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28cb expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.021489:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.021501:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 55 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.021521:0:7662:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.021535:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 55 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.021549:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587103.021552:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587103.021555:0:7662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 55 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.021563:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5400, rc 0) 00000100:00100000:2.0:1788587103.021627:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10560:x1875469181966464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 245us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.021634:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 111 00000040:00080000:1.0:1788587103.043523:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587103.043534:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587103.043583:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788587103.043591:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587103.043719:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb58c2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208195200:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587103.043887:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85946600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587103.058085:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb58c2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208195200:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587103.059277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.059559:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181966592 00000100:00100000:2.0:1788587103.059586:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181966592 00000100:00100000:2.0:1788587103.059645:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 112 00000100:00100000:2.0:1788587103.059655:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10561:x1875469181966592:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587103.059689:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587103.059794:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10561:x1875469181966592:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 140us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.059801:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 112 00000100:00100000:0.0:1788587103.064383:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.064495:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181966720 00000100:00100000:2.0:1788587103.064506:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181966720 00000100:00100000:2.0:1788587103.064593:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:2.0:1788587103.064605:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10561:x1875469181966720:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788587103.064684:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064701:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064713:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064782:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064790:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064797:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064820:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064861:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064870:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587103.064923:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788587103.064928:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587103.064945:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064957:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064964:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064971:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064977:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587103.064982:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.064990:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065001:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:2.0:1788587103.065005:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587103.065010:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065026:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab89275 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065041:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065047:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065054:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065059:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587103.065062:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065068:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065076:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8baca0968500) 00010000:00010000:2.0:1788587103.065078:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587103.065081:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065086:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab8927c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065101:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065118:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065130:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065135:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587103.065138:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065145:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065153:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587103.065156:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587103.065159:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.065165:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.065239:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10561:x1875469181966720:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 636us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.065247:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 113 00000100:00100000:3.0:1788587103.067753:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587103.068183:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181966976 00000100:00100000:1.0:1788587103.068192:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181966976 00000100:00100000:1.0:1788587103.068268:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:1.0:1788587103.068278:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:10561:x1875469181966976:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587103.068299:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587103.068318:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8928a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28d2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068424:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068439:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068450:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587103.068461:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788587103.068546:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068554:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068561:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068566:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52ba00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587103.068570:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068578:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068598:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:1.0:1788587103.068601:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788587103.068606:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068613:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab89291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068648:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8928a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28d2 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068656:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:1.0:1788587103.068658:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587103.068662:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab8928a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28d2 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.068671:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52aa00, rc 0) 00000100:00100000:1.0:1788587103.068724:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10561:x1875469181966976:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 448us (982us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788587103.068731:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 114 00000100:00100000:1.0:1788587103.070970:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.071039:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181967104 00000100:00100000:3.0:1788587103.071050:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181967104 00000100:00100000:3.0:1788587103.071115:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:3.0:1788587103.071124:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10561:x1875469181967104:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587103.071179:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587103.071300:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10561:x1875469181967104:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 176us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.071308:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:1.0:1788587103.074871:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.075148:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181967360 00000100:00100000:3.0:1788587103.075159:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181967360 00000100:00100000:3.0:1788587103.075217:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:3.0:1788587103.075228:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10561:x1875469181967360:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587103.075248:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587103.075251:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788587103.075278:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab8922f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28b6 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.075318:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587103.075323:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587103.075337:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8929f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587103.075741:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788587103.075973:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab892a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.075986:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab892a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.075996:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab892a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.076042:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8929f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28d9 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.076058:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab892a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28d9 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.076066:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc100) 00010000:00010000:3.0:1788587103.076068:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587103.076071:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051600, rc 0) 00000100:00100000:3.0:1788587103.076127:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:10561:x1875469181967360:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 903us (1292us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788587103.076134:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:3.0:1788587103.079523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.079749:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181967616 00000100:00100000:2.0:1788587103.079760:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181967616 00000100:00100000:0.0:1788587103.079888:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:0.0:1788587103.079900:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:10561:x1875469181967616:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587103.079969:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587103.079997:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab892a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28d9 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080017:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc100) 00010000:00010000:0.0:1788587103.080030:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587103.080052:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080066:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080076:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080090:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080096:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080129:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080196:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080204:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080211:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080217:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587103.080221:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080228:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080237:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587103.080240:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587103.080244:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080249:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab892b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080259:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080265:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080279:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080284:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587103.080287:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080294:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080302:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x152b3750 (ffff8bac90439400) 00010000:00010000:0.0:1788587103.080304:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587103.080307:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.080312:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab892bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x152b3750 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587103.080405:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10561:x1875469181967616:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 507us (893us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788587103.080412:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:1.0:1788587103.084394:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.084481:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181967744 00000100:00100000:3.0:1788587103.084492:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181967744 00000100:00100000:3.0:1788587103.084583:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:3.0:1788587103.084594:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:10561:x1875469181967744:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587103.084617:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587103.084642:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.084678:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.084691:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.084701:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.084805:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.084824:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.084833:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587103.084836:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587103.084878:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:3.0:1788587103.084940:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:10561:x1875469181967744:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 347us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.084956:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:1.0:1788587103.088554:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.088639:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181968000 00000100:00100000:3.0:1788587103.088650:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181968000 00000100:00100000:3.0:1788587103.088738:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:3.0:1788587103.088750:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:10561:x1875469181968000:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587103.088877:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.088895:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.088908:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587103.089176:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1788587103.089275:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000904a2c38 reply state 000000004adb5435 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587103.089284:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587103.089381:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:10561:x1875469181968000:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 633us (836us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788587103.089388:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:0.0:1788587103.094298:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:3.0:1788587103.094673:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.094687:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.094695:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.094715:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587103.094720:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.094728:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.094746:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587103.094749:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587103.094753:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.094760:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587103.094813:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181968128 00000100:00100000:1.0:1788587103.094823:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181968128 00000100:00100000:1.0:1788587103.095043:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:1.0:1788587103.095054:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:10561:x1875469181968128:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587103.095085:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587103.095113:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28e7 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.095170:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 59 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.095183:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 59 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.095198:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:1.0:1788587103.095200:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587103.095203:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52ba00, rc 0) 00000100:00100000:1.0:1788587103.095272:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:10561:x1875469181968128:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 219us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587103.095279:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:1.0:1788587103.097968:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587103.098065:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181968256 00000100:00100000:0.0:1788587103.098077:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181968256 00000100:00100000:0.0:1788587103.098155:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:0.0:1788587103.098165:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2360:x1875469181968256:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788587103.098498:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2360:x1875469181968256:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 334us (543us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788587103.098516:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00080000:3.0:1788587103.098683:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587103.101797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587103.101896:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181968512 00000100:00100000:0.0:1788587103.101908:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181968512 00000100:00100000:0.0:1788587103.101968:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:0.0:1788587103.101980:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:10561:x1875469181968512:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587103.102231:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10561:x1875469181968512:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 253us (443us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788587103.102239:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:2.0:1788587103.104440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587103.104538:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181968768 00000100:00100000:0.0:1788587103.104548:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181968768 00000100:00100000:0.0:1788587103.104603:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:0.0:1788587103.104612:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10561:x1875469181968768:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587103.104794:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10561:x1875469181968768:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 182us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587103.104802:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:1.0:1788587103.117772:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.118323:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181968896 00000100:00100000:3.0:1788587103.118333:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181968896 00000100:00100000:3.0:1788587103.118436:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:3.0:1788587103.118446:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:10561:x1875469181968896:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587103.118466:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587103.118489:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28ee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.118582:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.118600:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.118630:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587103.118671:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587103.118690:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.118718:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab892de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28ee expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.118737:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28ee expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.118746:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587103.118749:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788587103.118752:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587103.118823:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:10561:x1875469181968896:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 378us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.118831:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 122 00000100:00100000:2.0:1788587103.128071:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.130912:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181969024 00000100:00100000:3.0:1788587103.130927:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181969024 00000100:00100000:2.0:1788587103.131102:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1788587103.131221:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc98e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2361:x1875469181969024:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587103.131243:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587103.131286:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28f5 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587103.131316:0:6708:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac5e, blocks: 0x1 00010000:00010000:2.0:1788587103.131335:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788587103.131339:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587103.131359:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 10 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.131378:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 10 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.131392:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4e00, rc 0) 00000100:00100000:2.0:1788587103.131468:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc98e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2361:x1875469181969024:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 250us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587103.134932:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.135021:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:3.0:1788587103.135566:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181969280 00000100:00100000:3.0:1788587103.135575:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181969280 00000100:00100000:3.0:1788587103.135631:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:3.0:1788587103.135641:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:10561:x1875469181969280:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587103.135752:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:10561:x1875469181969280:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 111us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.135771:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:1.0:1788587103.140642:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.140785:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181969408 00000100:00100000:3.0:1788587103.140797:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181969408 00000100:00100000:3.0:1788587103.140884:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:3.0:1788587103.140896:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:10561:x1875469181969408:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587103.140915:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587103.140936:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c28fc expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.140967:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 11 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.140977:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587103.140981:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587103.140987:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.141026:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 11 pid: 6708 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.141041:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 11 pid: 6708 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587103.141053:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf949f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875469208195328:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587103.141161:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831f03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587103.152796:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.153515:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf949f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6707:1875469208195328:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587103.153573:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.153595:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051800, rc 0) 00000100:00100000:3.0:1788587103.153656:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+11:10561:x1875469181969408:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 12763us (13024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.153664:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:2.0:1788587103.153813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181969536 00000100:00100000:2.0:1788587103.153820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181969536 00010000:00010000:2.0:1788587103.153892:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 11 pid: 6708 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.153928:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:2.0:1788587103.153937:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+11:2362:x1875469181969536:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587103.153953:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587103.153976:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 11 pid: 6708 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.154007:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 11 pid: 6708 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.154028:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28f5 expref: 11 pid: 6708 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.154041:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587103.154044:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587103.154053:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.154064:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.154097:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 10 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.154109:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c58700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875469208195456:192.168.204.28@tcp:105: 00000100:00100000:2.0:1788587103.154157:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587103.162738:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c58700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875469208195456:192.168.204.28@tcp:105: 00010000:00010000:3.0:1788587103.162765:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587103.162828:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2362:x1875469181969536:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 8892us (10042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.162839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:1.0:1788587103.169969:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.170128:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181969664 00000100:00100000:2.0:1788587103.170140:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181969664 00002000:00100000:2.0:1788587103.170198:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8bac83098a80 x1875469181969664/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:419/0 lens 504/0 e 0 to 0 dl 1788587114 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587103.170210:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bac83098a80 with x1875469181969664 ext(0->12) 00002000:00010000:2.0:1788587103.170241:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bac83098a80 00000100:00100000:2.0:1788587103.170282:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:2.0:1788587103.170291:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2362:x1875469181969664:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587103.173296:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:2362:x1875469181969664:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 1240us (1573us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788587103.173313:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00002000:00100000:2.0:1788587103.173328:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8bac83098a80 x1875469181969664/t4294967308(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:419/0 lens 504/448 e 0 to 0 dl 1788587114 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587103.173339:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bac83098a80 with x1875469181969664 ext(0->12) 00002000:00010000:2.0:1788587103.173355:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bac83098a80 00000100:00100000:1.0:1788587103.189209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.189904:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181969792 00000100:00100000:2.0:1788587103.189914:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181969792 00000100:00100000:2.0:1788587103.189974:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 124 00000100:00100000:2.0:1788587103.189984:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:10561:x1875469181969792:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788587103.269259:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788587103.269279:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788587103.269301:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bac883c80c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788587103.269306:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac90785100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bac883c8a80 00000020:00080000:0.0:1788587103.269309:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac90785600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bacbb8d5000 00000020:00080000:0.0:1788587103.269403:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bacaf1b6e40 refcount 2 committed 0 result 0 batchid 2 00000100:00100000:1.0:1788587103.269406:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:10561:x1875469181969792:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 79416us (80198us total) trans 0 rc 0/0 00000020:00080000:0.0:1788587103.269406:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac98275e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bacaf1b60c0 00000020:00080000:0.0:1788587103.269409:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac98275000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bacbf937800 00000100:00100000:1.0:1788587103.269416:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 124 00000020:00080000:0.0:1788587103.269435:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1788587103.269447:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788587103.269582:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208195584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788587103.269634:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788587103.269664:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:0.0:1788587103.269699:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587103.269704:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208195712:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788587103.269726:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788587103.269888:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788587103.269906:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208195584 00000100:00100000:2.0:1788587103.269912:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208195584 00000100:00100000:2.0:1788587103.269965:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208195712 00000100:00100000:2.0:1788587103.269968:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208195712 00000100:00100000:2.0:1788587103.270002:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587103.270011:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208195584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788587103.270036:0:6708:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788587103.270063:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270096:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270106:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00000100:00080000:0.0:1788587103.270106:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788587103.270111:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587103.270116:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270143:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270158:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 11 pid: 6706 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.270170:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208195840:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587103.270231:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587103.270248:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788587103.270256:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208195712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788587103.270271:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788587103.270301:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bac5d, atime: 0x6a9bac5e, ctime: 0x6a9bac5d, blocks: 0x1 00010000:00010000:2.0:1788587103.270307:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270316:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:2.0:1788587103.270324:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587103.270330:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270357:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270368:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270376:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270395:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587103.270898:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208195712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 642us (1168us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788587103.270907:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788587103.270939:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587103.270946:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270954:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587103.270959:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270968:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.270997:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.271004:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc29a112/0xc1a730b05ab89301 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.271025:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587103.271027:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587103.271028:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788587103.271064:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bac90c5a680/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788587103.271070:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208195712:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788587103.273682:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.273829:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181969920 00000100:00100000:2.0:1788587103.273997:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181969920 00000100:00100000:2.0:1788587103.274122:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:2.0:1788587103.274135:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:2362:x1875469181969920:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788587103.278038:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208195840:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587103.278070:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587103.280491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587103.284662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181970048 00000100:00100000:0.0:1788587103.284678:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181970048 00010000:00010000:0.0:1788587103.285046:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 13 pid: 6706 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587103.285097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:0.0:1788587103.285107:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2361:x1875469181970048:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587103.285123:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587103.285129:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 13 pid: 6706 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285143:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 13 pid: 6706 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285172:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d208a525/0xc1a730b05ab890bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c285b expref: 13 pid: 6706 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285230:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587103.285243:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587103.285250:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285261:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285298:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587103.285378:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:2361:x1875469181970048:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 272us (4897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587103.285386:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00010000:00010000:3.0:1788587103.285511:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.285522:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.285531:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.285550:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.285571:0:6708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587103.285954:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587103.285961:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285970:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587103.285974:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285983:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.285995:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.286002:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab892fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.286029:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587103.286031:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587103.286033:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587103.286519:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208195584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16505us (16880us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788587103.286528:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788587103.286688:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bacbc89a300/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788587103.286699:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208195584:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788587103.328892:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788587103.329301:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788587103.329538:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181969920:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 55397us (55860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.329551:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000001:00080000:0.0:1788587103.330013:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1788587103.334494:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.334722:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181970304 00000100:00100000:3.0:1788587103.334733:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181970304 00000100:00100000:3.0:1788587103.334903:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 125 00000100:00100000:3.0:1788587103.334916:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:10561:x1875469181970304:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587103.334980:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587103.335017:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab892e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28ee expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.335039:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587103.335045:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587103.335075:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.335090:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.335527:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587103.335777:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021e50294 reply state 00000000bb834d15 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587103.335800:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587103.336204:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:10561:x1875469181970304:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 1288us (1717us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1788587103.336213:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 125 00010000:00010000:3.0:1788587103.339614:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.339634:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.339642:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.339649:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587103.339654:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.339662:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.339679:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587103.339682:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587103.339687:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.339693:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89308 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587103.341119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.341352:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181970432 00000100:00100000:3.0:1788587103.341362:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181970432 00000100:00100000:3.0:1788587103.341440:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1788587103.341450:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181970432:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788587103.341656:0:10779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788587103.341660:0:10779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788587102 00002000:00010000:3.0:1788587103.341663:0:10779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788587102 00002000:00010000:3.0:1788587103.341665:0:10779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788587102 -> 1788587102 00002000:00010000:3.0:1788587103.341667:0:10779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788587103.341735:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181970432:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 286us (630us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788587103.341744:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:1.0:1788587103.344985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.345208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181970688 00000100:00100000:2.0:1788587103.345219:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181970688 00000100:00100000:2.0:1788587103.345279:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:2.0:1788587103.345290:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:10561:x1875469181970688:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788587103.345375:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.345412:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.345421:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.345456:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.345471:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 15 pid: 5851 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.345486:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208195968:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587103.345590:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587103.349307:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.349422:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208195968:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587103.349450:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587103.349590:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181970816 00000100:00100000:3.0:1788587103.349600:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181970816 00010000:00010000:3.0:1788587103.349639:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 16 pid: 5851 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587103.349714:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:3.0:1788587103.349725:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:2361:x1875469181970816:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587103.349740:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587103.349747:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 16 pid: 5851 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.349760:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 16 pid: 5851 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.349781:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab892c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e0 expref: 16 pid: 5851 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.349815:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587103.349820:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.349830:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.349839:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.349905:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587103.349957:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:2361:x1875469181970816:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 233us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587103.349965:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00010000:00010000:0.0:1788587103.350016:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350024:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350056:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350064:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350071:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350077:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587103.350082:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350089:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350118:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:0.0:1788587103.350121:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788587103.350125:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.350130:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8930f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587103.350173:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:10561:x1875469181970688:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 4885us (5197us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788587103.350181:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 126 00000100:00100000:0.0:1788587103.353235:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.353410:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181970944 00000100:00100000:2.0:1788587103.353423:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181970944 00000100:00100000:2.0:1788587103.353532:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:2.0:1788587103.353542:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469181970944:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788587103.353587:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.353619:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.353642:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587103.353647:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587103.353652:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.353686:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.353700:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 7 pid: 6707 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.353716:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208196096:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587103.353798:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587103.363164:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208196096:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587103.363617:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587103.364089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.364188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181971072 00000100:00100000:2.0:1788587103.364197:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181971072 00010000:00010000:2.0:1788587103.364324:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 8 pid: 6707 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.364446:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:2.0:1788587103.364459:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181971072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587103.364488:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587103.364512:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 8 pid: 6707 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.364526:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 8 pid: 6707 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.364548:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009695cf8d/0xc1a730b05ab892f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28fc expref: 8 pid: 6707 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.364564:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587103.364568:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587103.364573:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.364583:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.364616:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587103.364635:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.364644:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.364668:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.364675:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181971072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 219us (589us total) trans 0 rc 0/0 00010000:00010000:0.0:1788587103.364678:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.364682:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00010000:00010000:0.0:1788587103.364686:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.364705:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587103.364709:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.364719:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.364736:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.364744:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c124d7c5/0xc1a730b05ab89316 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587103.364790:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181970944:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 11250us (11565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587103.364798:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:1.0:1788587103.369423:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.369557:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181971328 00000100:00100000:2.0:1788587103.369567:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181971328 00000100:00100000:2.0:1788587103.369629:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 127 00000100:00100000:2.0:1788587103.369640:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:10561:x1875469181971328:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587103.369739:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.369757:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.369769:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.370784:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.370806:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 15 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.370816:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.374060:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 15 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.374087:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 15 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.374109:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208196224:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587103.374247:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788587103.377929:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208196224:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587103.377963:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587103.380717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.381435:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181971456 00000100:00100000:2.0:1788587103.381449:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181971456 00010000:00010000:2.0:1788587103.381500:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 16 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.382450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:2.0:1788587103.382468:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:2362:x1875469181971456:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587103.382487:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587103.382497:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 16 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.382513:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 16 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.382539:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52ba00/0xc1a730b05ab892d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28e7 expref: 16 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.382558:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:2.0:1788587103.382564:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.382574:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.382582:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.382607:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587103.382680:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:2362:x1875469181971456:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 220us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587103.382689:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00010000:00010000:0.0:1788587103.382762:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.382772:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587103.383031:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788587103.383210:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788587103.383255:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788587103.383354:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208196352:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788587103.383423:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587103.383460:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587103.384518:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208196352 00000100:00100000:1.0:1788587103.384531:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208196352 00000100:00100000:1.0:1788587103.384592:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587103.384602:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1875469208196352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788587103.384692:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1875469208196352:12345-0@lo:1000:mdt00_002.0 Request processed in 92us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587103.384699:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587103.385408:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788587103.385417:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1788587103.385442:0:5852:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bacbc89a300 x1875469208195584/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587119 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587103.385456:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208196352:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788587103.386352:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788587103.386499:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208196480:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788587103.386561:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587103.386658:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacc1ab9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587103.388603:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208196480 00000100:00100000:1.0:1788587103.388620:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208196480 00000100:00100000:1.0:1788587103.388695:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587103.388706:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1875469208196480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788587103.389160:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5852:x1875469208196480:12345-0@lo:1000:mdt00_002.0 Request processed in 454us (2596us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788587103.389169:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788587103.389389:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208196480:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788587103.389449:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389459:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389467:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389472:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587103.389477:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389485:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389500:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:2.0:1788587103.389503:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587103.389508:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389520:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab89324 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389553:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389559:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389565:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389579:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587103.389582:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389588:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389596:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587103.389598:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587103.389605:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389617:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389625:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.389659:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.389674:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208196608:192.168.204.28@tcp:105: 00000100:00100000:2.0:1788587103.389807:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587103.393410:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208196608:192.168.204.28@tcp:105: 00010000:00010000:2.0:1788587103.393443:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393471:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89267 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393504:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393519:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393530:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393540:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393546:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393553:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393558:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587103.393562:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393569:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393579:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587103.393582:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587103.393585:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393595:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8932b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393606:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393611:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393617:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393622:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587103.393625:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393630:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393637:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587103.393639:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587103.393641:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.393646:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8931d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.393906:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:10561:x1875469181971328:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 24266us (24493us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788587103.393916:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 127 00000020:00080000:2.0:1788587103.393930:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788587103.394217:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587103.394221:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587103.394733:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788587103.394742:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587103.402673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.402712:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587103.402794:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181971840 00000100:00100000:0.0:1788587103.402805:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181971840 00000100:00100000:0.0:1788587103.402872:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181971584 00000100:00100000:0.0:1788587103.402876:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181971584 00000100:00100000:0.0:1788587103.402909:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:0.0:1788587103.402920:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:10561:x1875469181971840:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788587103.403780:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788587103.404009:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788587103.404445:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.404465:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.404488:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.404498:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.404504:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.404510:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.404663:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587103.404789:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10561:x1875469181971840:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1866us (2122us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788587103.404799:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00000020:00080000:0.0:1788587103.404806:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788587103.404838:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:0.0:1788587103.404876:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84660450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:10560:x1875469181971584:12345-192.168.204.28@tcp:49:lfs.0 00000100:00100000:0.0:1788587103.404957:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84660450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:10560:x1875469181971584:12345-192.168.204.28@tcp:49:lfs.0 Request processed in 85us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587103.404963:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00010000:00010000:2.0:1788587103.408022:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587103.408041:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.408052:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587103.408057:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.408067:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.408088:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8bac90439400) 00010000:00010000:2.0:1788587103.408091:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788587103.408096:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.408102:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.408131:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587103.408134:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587103.408136:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587103.410153:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587103.410265:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181972096 00000100:00100000:1.0:1788587103.410276:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181972096 00000100:00100000:1.0:1788587103.410356:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:1.0:1788587103.410368:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:10560:x1875469181972096:12345-192.168.204.28@tcp:58:lfs.0 00000040:00080000:1.0:1788587103.410682:0:7662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788587103.410781:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:10560:x1875469181972096:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 415us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587103.410790:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 128 00000100:00100000:1.0:1788587103.445679:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587103.445772:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181972224 00000100:00100000:3.0:1788587103.445782:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181972224 00000100:00100000:3.0:1788587103.445878:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 129 00000100:00100000:3.0:1788587103.445890:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:10563:x1875469181972224:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587103.445911:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587103.445932:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2903 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.445999:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.446031:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587103.446043:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.446238:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.446250:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.446257:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.446518:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.446681:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 21 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.446691:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.446730:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 21 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587103.447209:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 21 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587103.447226:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208196736:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587103.447329:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587103.449439:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208196736:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587103.449469:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587103.452731:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587103.453047:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181972480 00000100:00100000:2.0:1788587103.453057:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181972480 00000100:00100000:2.0:1788587103.453158:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:2.0:1788587103.453169:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:5602:x1875469181972480:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788587103.453585:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:5602:x1875469181972480:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 416us (861us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788587103.453593:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:3.0:1788587103.455803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587103.456230:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181972608 00000100:00100000:0.0:1788587103.456241:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181972608 00010000:00010000:0.0:1788587103.456363:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 23 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587103.456408:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:0.0:1788587103.456434:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88342c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:2361:x1875469181972608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587103.456450:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587103.456457:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 23 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.456470:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 23 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.456494:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89259 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28c4 expref: 23 pid: 7662 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.456514:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:0.0:1788587103.456519:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.456529:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.456537:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587103.456576:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587103.456624:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456636:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587103.456641:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88342c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:2361:x1875469181972608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 206us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587103.456654:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000004:00200000:1.0:1788587103.456693:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788587103.456700:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587103.456725:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456738:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456759:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456766:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456774:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456780:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587103.456785:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456801:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456812:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:1.0:1788587103.456815:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587103.456820:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456825:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456837:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456890:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456897:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456902:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587103.456904:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456911:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456918:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8baca0968e00) 00010000:00010000:1.0:1788587103.456921:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587103.456924:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456940:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.456988:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2903 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.457007:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2903 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587103.457015:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:1.0:1788587103.457017:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587103.457020:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5800, rc 0) 00000100:00100000:1.0:1788587103.457051:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10563:x1875469181972224:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 11164us (11384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587103.457057:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 129 00010000:00010000:0.0:1788587103.947751:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587104.265496:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208196864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.265571:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587104.265618:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8309a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208197376:0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.265642:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587104.265666:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788587104.265672:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8309b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208196992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.265695:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587104.265714:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8309b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208197504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.265736:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587104.265767:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208196864 00000100:00100000:1.0:1788587104.265786:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208196864 00000100:00100000:1.0:1788587104.265833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788587104.265866:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208196864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.265925:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208196864:12345-0@lo:400:kworker.0 Request processed in 84us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587104.265932:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788587104.265967:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208197376 00000100:00100000:1.0:1788587104.265970:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208197376 00000100:00100000:1.0:1788587104.266158:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208196992 00000100:00100000:1.0:1788587104.266163:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208196992 00000100:00100000:1.0:1788587104.266185:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788587104.266190:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208197376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.266224:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208197376:12345-0@lo:400:kworker.0 Request processed in 33us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587104.266230:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788587104.266242:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788587104.266248:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208196992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.266276:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208196992:12345-0@lo:400:kworker.0 Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587104.266282:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788587104.266298:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208197504 00000100:00100000:1.0:1788587104.266301:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208197504 00000100:00100000:1.0:1788587104.266337:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587104.266343:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875469208197504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.266370:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875469208197504:12345-0@lo:400:kworker.0 Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587104.266376:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587104.266423:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8309b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208196992:0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.266434:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8309b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208197504:0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.266441:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208196864:0@lo:400:kworker.0 00000100:00100000:1.0:1788587104.266448:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8309a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208197376:0@lo:400:kworker.0 00000100:00100000:0.0:1788587104.267385:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8309bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208197120:0@lo:400:kworker.0 00000100:00100000:0.0:1788587104.267430:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587104.267462:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587104.267468:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208197248:0@lo:400:kworker.0 00000100:00100000:0.0:1788587104.267493:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587104.267532:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208197120 00000100:00100000:0.0:1788587104.267537:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208197120 00000100:00100000:0.0:1788587104.267577:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788587104.267583:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208197120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587104.267626:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208197120:12345-0@lo:400:kworker.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587104.267633:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788587104.267651:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587104.267656:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587104.267666:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208197248 00000100:00100000:0.0:1788587104.267669:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208197248 00000100:00100000:0.0:1788587104.267690:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788587104.267695:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208197248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587104.267723:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208197248:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587104.267729:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788587104.267758:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208197248:0@lo:400:kworker.0 00000100:00100000:0.0:1788587104.267766:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8309bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208197120:0@lo:400:kworker.0 00000004:00080000:2.0:1788587104.268470:0:7144:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426472625331ns, next at 427472623001ns, rc = 0 00000100:00100000:0.0:1788587104.268653:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208197632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587104.268701:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587104.268747:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208197632 00000100:00100000:0.0:1788587104.268752:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208197632 00000100:00100000:0.0:1788587104.268789:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788587104.268797:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208197632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587104.268821:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788587104.268877:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208197632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587104.268884:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788587104.269249:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208197632:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788587104.341728:0:12130:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587104.341738:0:12130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587104.341783:0:12130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788587104.341789:0:12130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788587104.452504:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587104.452514:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587104.452564:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788587104.452572:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587104.452721:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208197760:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587104.452863:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacc1ab9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587104.457808:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83050000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208197760:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587104.460166:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587104.461603:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181972736 00000100:00100000:1.0:1788587104.461617:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181972736 00000100:00100000:1.0:1788587104.461709:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00100000:1.0:1788587104.461720:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10576:x1875469181972736:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587104.461758:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587104.461898:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10576:x1875469181972736:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 179us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587104.461906:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 130 00000100:00100000:2.0:1788587104.469579:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587104.469709:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181972992 00000100:00100000:1.0:1788587104.469721:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181972992 00000100:00100000:1.0:1788587104.469801:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:1.0:1788587104.469812:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:10576:x1875469181972992:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587104.469838:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587104.469892:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89355 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c290a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.470025:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8935c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.470054:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8935c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.470070:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8935c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587104.470085:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788587104.470245:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab89355 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c290a expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.470266:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8935c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c290a expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.470274:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:1.0:1788587104.470277:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587104.470281:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52b600, rc 0) 00000100:00100000:1.0:1788587104.470357:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:10576:x1875469181972992:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 546us (788us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788587104.470363:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 131 00000100:00100000:0.0:1788587104.481040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587104.481120:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181973120 00000100:00100000:3.0:1788587104.481131:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181973120 00000100:00100000:3.0:1788587104.481413:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788587104.481428:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:2362:x1875469181973120:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587104.481447:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587104.481479:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8935c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c290a expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587104.481498:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:3.0:1788587104.481504:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587104.481573:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:2362:x1875469181973120:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 149us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587104.488379:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788587104.496817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587104.498360:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181973376 00000100:00100000:1.0:1788587104.498377:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181973376 00000100:00100000:1.0:1788587104.498449:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 132 00000100:00100000:1.0:1788587104.498460:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:10576:x1875469181973376:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788587104.498565:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498586:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498606:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498835:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498843:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498870:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498876:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587104.498881:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498889:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498903:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:1.0:1788587104.498906:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587104.498910:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587104.498916:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8936a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587104.499083:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:10576:x1875469181973376:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 623us (2278us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788587104.499092:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 132 00000040:00080000:1.0:1788587104.499363:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587104.499368:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587104.499870:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788587104.499879:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587104.512702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587104.513811:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181973632 00000100:00100000:0.0:1788587104.513827:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181973632 00000100:00100000:0.0:1788587104.513912:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:0.0:1788587104.513932:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:10576:x1875469181973632:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788587104.514188:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:10576:x1875469181973632:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 257us (1495us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788587104.514196:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:3.0:1788587104.771442:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208197888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587104.771526:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587104.771758:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208197888 00000100:00100000:1.0:1788587104.771777:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208197888 00000100:00100000:1.0:1788587104.771838:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788587104.771875:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208197888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587104.771909:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587104.771952:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208197888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587104.771959:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788587104.772434:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbbcca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208197888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788587104.963685:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587105.987107:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587106.322461:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587106.322511:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587106.322538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587106.322558:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587106.322584:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587106.322614:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181974016 00000100:00100000:1.0:1788587106.322624:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181974016 00000100:00100000:1.0:1788587106.322702:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181974144 00000100:00100000:1.0:1788587106.322705:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181974144 00000100:00100000:1.0:1788587106.322733:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:1.0:1788587106.322753:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181974016:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587106.322824:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181974016:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587106.322831:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:1.0:1788587106.322895:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:1.0:1788587106.322902:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181974144:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587106.322940:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181974144:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587106.322948:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:1.0:1788587106.322967:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181974272 00000100:00100000:1.0:1788587106.322970:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181974272 00000100:00100000:1.0:1788587106.322997:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181973888 00000100:00100000:1.0:1788587106.323000:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181973888 00000100:00100000:1.0:1788587106.323020:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:1.0:1788587106.323026:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181974272:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587106.323160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181973760 00000100:00100000:3.0:1788587106.323165:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181973760 00000100:00100000:3.0:1788587106.323196:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 295 00000100:00100000:3.0:1788587106.323204:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181973760:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587106.323232:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2361:x1875469181973760:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587106.323237:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 295 00000100:00100000:3.0:1788587106.323269:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00100000:3.0:1788587106.323275:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:2361:x1875469181973888:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587106.323316:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:2361:x1875469181973888:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 41us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587106.323323:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00080000:3.0:1788587106.323511:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587106.323516:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587106.323518:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587106.326529:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2361:x1875469181974272:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 3493us (3979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587106.326544:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 153 00000040:00080000:3.0:1788587106.490707:0:12182:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587106.490717:0:12182:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587106.490761:0:12182:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788587106.490767:0:12182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788587106.772399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587106.772899:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181974528 00000100:00100000:3.0:1788587106.772919:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181974528 00000100:00100000:3.0:1788587106.773018:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:3.0:1788587106.773042:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:10596:x1875469181974528:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587106.773077:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587106.773107:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89371 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2911 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.773312:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89378 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.773332:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89378 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.773348:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89378 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587106.773362:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788587106.773546:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89371 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2911 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.773574:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89378 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2911 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.773586:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:3.0:1788587106.773590:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788587106.773594:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051c00, rc 0) 00000100:00100000:3.0:1788587106.773680:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:10596:x1875469181974528:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 652us (1293us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788587106.773688:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 133 00000100:00100000:1.0:1788587106.781258:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587106.783221:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181974656 00000100:00100000:3.0:1788587106.783243:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181974656 00000100:00100000:3.0:1788587106.783351:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 134 00000100:00100000:3.0:1788587106.783365:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:10596:x1875469181974656:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1788587106.783474:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783518:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783535:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783575:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783583:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783593:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783600:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587106.783606:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783616:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783631:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:3.0:1788587106.783634:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587106.783641:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587106.783649:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587106.783760:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:10596:x1875469181974656:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 398us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587106.783777:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 134 00000001:00080000:0.0:1788587106.917288:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788587106.917320:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788587106.917329:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788587106.947682:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587106.947872:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181974784 00000100:00100000:1.0:1788587106.947882:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181974784 00000100:00100000:1.0:1788587106.947992:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:1.0:1788587106.948004:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181974784:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:1.0:1788587106.948024:0:10779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587106.948056:0:10779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be6742e9/0xc1a730b05ab8938d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2918 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587106.948085:0:10779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bac5e, atime: 0x6a9bac5e, ctime: 0x6a9bac5e, blocks: 0xb 00010000:00010000:1.0:1788587106.948116:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=429s v=(0 0) 00010000:00010000:1.0:1788587106.948121:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587106.948130:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be6742e9/0xc1a730b05ab8938d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2918 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587106.948164:0:10779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be6742e9/0xc1a730b05ab8938d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2918 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587106.948177:0:10779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52ba00, rc 0) 00000100:00100000:1.0:1788587106.948246:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181974784:12345-192.168.204.28@tcp:101:cat.0 Request processed in 244us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587106.948253:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1788587106.956168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587106.956264:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181974912 00000100:00100000:2.0:1788587106.956286:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181974912 00002000:00100000:2.0:1788587106.956416:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8bacbf949c00 x1875469181974912/t0(0) o3->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:422/0 lens 488/0 e 0 to 0 dl 1788587117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587106.956429:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacbf949c00 with x1875469181974912 ext(0->4095) 00002000:00010000:2.0:1788587106.956436:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacbf949c00 00000100:00100000:2.0:1788587106.956470:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1788587106.956480:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181974912:12345-192.168.204.28@tcp:3:cat.0 00000100:00100000:2.0:1788587106.956958:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181974912:12345-192.168.204.28@tcp:3:cat.0 Request processed in 478us (800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788587106.956967:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00002000:00100000:2.0:1788587106.956975:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8bacbf949c00 x1875469181974912/t0(0) o3->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:422/0 lens 488/4536 e 0 to 0 dl 1788587117 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587106.956983:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacbf949c00 with x1875469181974912 ext(0->4095) 00002000:00010000:2.0:1788587106.956986:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacbf949c00 00010000:00010000:2.0:1788587107.015622:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587108.037774:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788587108.467299:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788587108.467330:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bac9ec9cf00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788587108.467336:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac90785900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bac8246c000 00000020:00080000:1.0:1788587108.467340:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac90785200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bac88250c00 00000004:00080000:1.0:1788587108.467375:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788587108.467395:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788587108.467404:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788587108.469493:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788587108.469683:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788587108.470946:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587108.470974:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208198016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788587108.471272:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587108.471891:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198016 00000100:00100000:3.0:1788587108.471901:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198016 00000100:00100000:3.0:1788587108.471963:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788587108.471973:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875469208198016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788587108.472263:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00000100:00080000:1.0:1788587108.472263:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788587108.474871:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788587102 -> 1788587102 00002000:00010000:3.0:1788587108.474875:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788587102 -> 1788587102 00002000:00010000:3.0:1788587108.474878:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788587102 -> 1788587102 00002000:00010000:3.0:1788587108.474880:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788587108.475695:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1875469208198016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3718us (4418us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788587108.475708:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:3.0:1788587108.475777:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bac90c59f80/2, rc 0, transno 4294967312 00000100:00100000:3.0:1788587108.475786:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208198016:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1788587108.505994:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788587108.506018:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000040:00080000:2.0:1788587108.614807:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587108.614817:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587108.614892:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788587108.614916:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788587109.059095:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587109.379076:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587109.379106:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208198528:0@lo:400:kworker.0 00000100:00100000:1.0:1788587109.379119:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208198400:0@lo:400:kworker.0 00000100:00100000:0.0:1788587109.379204:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587109.379220:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208198656:0@lo:400:kworker.0 00000100:00100000:2.0:1788587109.379513:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208198272:0@lo:400:kworker.0 00000100:00100000:3.0:1788587109.380129:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587109.380616:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587109.380645:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208198784:0@lo:400:kworker.0 00000100:00100000:3.0:1788587109.380675:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198656 00000100:00100000:2.0:1788587109.380677:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587109.380685:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198656 00000100:00100000:2.0:1788587109.380710:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587109.380724:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208198912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587109.380736:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198272 00000100:00100000:3.0:1788587109.380739:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198272 00000100:00100000:2.0:1788587109.380762:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587109.380767:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788587109.380776:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208198656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587109.380803:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788587109.380813:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208198272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587109.380863:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208198656:12345-0@lo:400:kworker.0 Request processed in 88us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587109.380870:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788587109.380908:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208198656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587109.381090:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587109.381124:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198528 00000100:00100000:1.0:1788587109.381128:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198528 00000100:00100000:1.0:1788587109.381155:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198784 00000100:00100000:1.0:1788587109.381158:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198784 00000100:00100000:1.0:1788587109.381181:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587109.381188:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208198528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587109.381508:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208198272:12345-0@lo:400:kworker.0 Request processed in 696us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.381516:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788587109.381532:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198400 00000100:00100000:2.0:1788587109.381536:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198400 00000100:00100000:0.0:1788587109.381544:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8309b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208198144:0@lo:400:kworker.0 00000100:00100000:2.0:1788587109.381566:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788587109.381575:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208198400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587109.381588:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587109.381624:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208198400:12345-0@lo:400:kworker.0 Request processed in 51us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.381631:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788587109.381663:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208198272:0@lo:400:kworker.0 00000100:00100000:2.0:1788587109.381717:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587109.381725:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208198784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587109.381759:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208198784:12345-0@lo:400:kworker.0 Request processed in 36us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.381775:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587109.381794:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198912 00000100:00100000:2.0:1788587109.381798:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198912 00000100:00100000:2.0:1788587109.381823:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788587109.381831:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208198912:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587109.381868:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875469208198528:12345-0@lo:400:kworker.0 Request processed in 679us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587109.381881:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00002000:00000024:2.0:1788587109.381894:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587109.381914:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208198400:0@lo:400:kworker.0 00000100:00100000:2.0:1788587109.381940:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208198912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.381947:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788587109.382160:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788587109.382166:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bacbc89a300, transno 4294967309 00000004:00080000:0.0:1788587109.382177:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00080000:2.0:1788587109.382189:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587109.382195:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587109.382515:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bac90c59f80 x1875469208198016/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788587124 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587109.382528:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208198528:0@lo:400:kworker.0 00000100:00100000:0.0:1788587109.382564:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208198144 00000100:00100000:0.0:1788587109.382569:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208198144 00000100:00100000:2.0:1788587109.382578:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208198912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587109.382594:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788587109.382598:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788587109.382610:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bac90c5a680, transno 4294967304 00000100:00100000:2.0:1788587109.382623:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208198784:0@lo:400:kworker.0 00000100:00100000:3.0:1788587109.382758:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788587109.382768:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208198144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587109.382817:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208198144:12345-0@lo:400:kworker.0 Request processed in 51us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587109.382824:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788587109.382832:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8309b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208198144:0@lo:400:kworker.0 00000100:00100000:1.0:1788587109.896292:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587109.896317:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208199040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587109.896390:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587109.896499:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199040 00000100:00100000:2.0:1788587109.896508:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199040 00000100:00100000:2.0:1788587109.896566:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587109.896576:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208199040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587109.896610:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587109.896659:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208199040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587109.896665:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788587109.896720:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208199040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587110.091487:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587111.107424:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587111.441993:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587111.442047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587111.442092:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587111.442124:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587111.442146:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181975040 00000100:00100000:1.0:1788587111.442157:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181975040 00000100:00100000:2.0:1788587111.442158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587111.442201:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181975552 00000100:00100000:2.0:1788587111.442207:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181975552 00000100:00100000:1.0:1788587111.442230:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 297 00000100:00100000:1.0:1788587111.442243:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181975040:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587111.442256:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181975168 00000100:00100000:2.0:1788587111.442260:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181975168 00000100:00100000:2.0:1788587111.442286:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00100000:2.0:1788587111.442294:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181975552:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587111.442319:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181975040:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 78us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587111.442327:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 297 00000100:00100000:2.0:1788587111.442333:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469181975552:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 39us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587111.442343:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00100000:2.0:1788587111.442361:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:2.0:1788587111.442369:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2360:x1875469181975168:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587111.442374:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181975296 00000100:00100000:1.0:1788587111.442379:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181975296 00000100:00100000:2.0:1788587111.442400:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2360:x1875469181975168:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587111.442408:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:1.0:1788587111.442413:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181975424 00000100:00100000:1.0:1788587111.442417:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181975424 00000100:00080000:2.0:1788587111.442430:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587111.442435:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587111.442437:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587111.442483:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:2.0:1788587111.442490:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181975296:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587111.442535:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181975296:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 46us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587111.442543:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:1.0:1788587111.442584:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:1.0:1788587111.442593:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181975424:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587111.442625:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469181975424:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 35us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587111.442632:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00010000:00010000:0.0:1788587112.133300:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587112.849340:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587112.849461:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181975680 00000100:00100000:2.0:1788587112.849472:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181975680 00000100:00100000:2.0:1788587112.849544:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:2.0:1788587112.849555:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:10241:x1875469181975680:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788587112.849685:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:10241:x1875469181975680:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587112.849693:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 135 00000100:00100000:3.0:1788587112.851528:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587112.851642:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181975936 00000100:00100000:1.0:1788587112.851653:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181975936 00000100:00100000:1.0:1788587112.851728:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:1.0:1788587112.851740:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:10241:x1875469181975936:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788587112.852149:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:10241:x1875469181975936:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 409us (631us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788587112.852170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00010000:00010000:2.0:1788587113.155460:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587113.189235:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587113.189603:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181976064 00000100:00100000:2.0:1788587113.189627:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181976064 00000100:00100000:2.0:1788587113.189726:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 136 00000100:00100000:2.0:1788587113.189738:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+5:11049:x1875469181976064:12345-192.168.204.28@tcp:101:lsof.0 00010000:00010000:2.0:1788587113.189758:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587113.189784:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c291f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587113.189802:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788587113.189893:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.189910:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.189922:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587113.189992:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587113.189996:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587113.190042:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.190069:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.190088:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587113.190097:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:2.0:1788587113.190100:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587113.190105:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5e00, rc 0) 00000100:00100000:2.0:1788587113.190182:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab703820-03cd-48f7-bca8-7e3164455d6c+6:11049:x1875469181976064:12345-192.168.204.28@tcp:101:lsof.0 Request processed in 447us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587113.190189:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 136 00000001:00080000:1.0:1788587113.557493:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1788587113.557515:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788587113.557596:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788587113.557616:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1788587113.584236:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:0.0:1788587114.179745:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587114.505245:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208199168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587114.505332:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587114.505577:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199168 00000100:00100000:2.0:1788587114.505586:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199168 00000100:00100000:2.0:1788587114.505653:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587114.505665:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208199168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587114.505702:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587114.505751:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208199168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.505759:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788587114.506113:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208199296:0@lo:400:kworker.0 00000100:00100000:2.0:1788587114.506172:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587114.506203:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac88268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208199808:0@lo:400:kworker.0 00000100:00100000:2.0:1788587114.506227:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587114.506248:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587114.506254:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208199424:0@lo:400:kworker.0 00000100:00100000:2.0:1788587114.506278:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587114.506317:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199808 00000100:00100000:2.0:1788587114.506322:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199808 00000100:00100000:2.0:1788587114.506354:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587114.506361:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208199808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587114.506401:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208199808:12345-0@lo:400:kworker.0 Request processed in 40us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.506406:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788587114.506428:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199424 00000100:00100000:2.0:1788587114.506431:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199424 00000100:00100000:2.0:1788587114.506465:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788587114.506472:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208199424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587114.506501:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208199424:12345-0@lo:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587114.506507:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788587114.506544:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208199424:0@lo:400:kworker.0 00000100:00100000:2.0:1788587114.506555:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac88268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208199808:0@lo:400:kworker.0 00000100:00080000:1.0:1788587114.506756:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587114.506760:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587114.506782:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208199680:0@lo:400:kworker.0 00000100:00100000:1.0:1788587114.506824:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587114.506874:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788587114.506879:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bac90c59f80, transno 4294967312 00000100:00100000:1.0:1788587114.506904:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208199168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587114.506917:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587114.506922:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8a7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208199552:0@lo:400:kworker.0 00000100:00100000:1.0:1788587114.506946:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587114.506972:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199680 00000100:00100000:1.0:1788587114.506975:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199680 00000100:00100000:1.0:1788587114.507004:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199552 00000100:00100000:1.0:1788587114.507006:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199552 00000100:00100000:1.0:1788587114.507021:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788587114.507026:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208199680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587114.507060:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208199680:12345-0@lo:400:kworker.0 Request processed in 33us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587114.507080:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788587114.507093:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788587114.507099:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208199552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587114.507136:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208199552:12345-0@lo:400:kworker.0 Request processed in 28us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587114.507142:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1788587114.507155:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587114.507173:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208199552:0@lo:400:kworker.0 00000100:00100000:1.0:1788587114.507183:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208199680:0@lo:400:kworker.0 00000100:00100000:0.0:1788587114.508176:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199296 00000100:00100000:0.0:1788587114.508185:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199296 00000100:00100000:0.0:1788587114.508233:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788587114.508242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208199296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587114.508313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208199296:12345-0@lo:400:kworker.0 Request processed in 64us (2133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587114.508321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788587114.508880:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8a7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208199296:0@lo:400:kworker.0 00000100:00100000:3.0:1788587115.013410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587115.013442:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208199936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587115.013521:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587115.013974:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208199936 00000100:00100000:1.0:1788587115.013983:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208199936 00000100:00100000:1.0:1788587115.014039:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788587115.014049:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208199936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587115.014088:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587115.014157:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208199936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587115.014164:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788587115.014495:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208199936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788587115.206629:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587116.230286:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587116.560072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587116.560141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181976192 00000100:00100000:2.0:1788587116.560165:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181976192 00000100:00100000:0.0:1788587116.560201:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587116.560225:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 299 00000100:00100000:0.0:1788587116.560226:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587116.560235:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181976192:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587116.560246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587116.560269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587116.560312:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181976192:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587116.560326:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181976448 00000100:00100000:3.0:1788587116.560330:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181976448 00000100:00100000:2.0:1788587116.560330:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 299 00000100:00100000:3.0:1788587116.560367:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181976576 00000100:00100000:3.0:1788587116.560370:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181976576 00000100:00100000:3.0:1788587116.560392:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:3.0:1788587116.560399:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181976448:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587116.568299:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181976704 00000100:00100000:0.0:1788587116.568315:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181976704 00000100:00100000:0.0:1788587116.568396:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181976320 00000100:00100000:0.0:1788587116.568400:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181976320 00000100:00100000:0.0:1788587116.568433:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00100000:0.0:1788587116.568445:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2359:x1875469181976704:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587116.569415:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2359:x1875469181976448:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 9009us (9206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587116.569429:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:0.0:1788587116.570261:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2359:x1875469181976704:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1814us (10028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587116.570273:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00100000:0.0:1788587116.570297:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 164 00000100:00100000:0.0:1788587116.570309:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2359:x1875469181976320:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587116.570350:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2359:x1875469181976320:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 45us (10102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587116.570356:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 164 00000100:00100000:3.0:1788587116.570427:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:3.0:1788587116.570439:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469181976576:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587116.570467:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469181976576:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 32us (10197us total) trans 0 rc 0/0 00000100:00080000:2.0:1788587116.574291:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587116.574301:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587116.574304:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587116.581752:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00000001:02000400:0.0:1788587117.106547:0:12386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 01:45:15 (1788587115) 00010000:00010000:0.0:1788587117.258480:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587118.275359:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587118.485809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587118.486113:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181976960 00000100:00100000:0.0:1788587118.486124:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181976960 00000100:00100000:0.0:1788587118.486212:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 137 00000100:00100000:0.0:1788587118.486223:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:11314:x1875469181976960:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587118.486260:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587118.486281:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab893a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2926 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486364:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486381:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486394:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486409:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486417:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486424:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486709:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab893b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486718:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab893b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486725:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab893b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587118.486744:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788587118.486917:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486927:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486934:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486941:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587118.486946:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486954:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486966:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baca1025d00) 00010000:00010000:0.0:1788587118.486969:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587118.486974:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486981:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab893a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486993:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.486999:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487005:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487022:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587118.487025:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487032:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487040:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8bac90439f00) 00010000:00010000:0.0:1788587118.487042:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587118.487046:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487063:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab893b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487427:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab893a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2926 expref: 16 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487442:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab893b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2926 expref: 15 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587118.487450:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:0.0:1788587118.487452:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587118.487455:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99a00, rc 0) 00000100:00100000:0.0:1788587118.487529:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:11314:x1875469181976960:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 1309us (1731us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788587118.487537:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 137 00000100:00080000:2.0:1788587118.487886:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587118.500364:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587118.500467:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587118.501675:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181977216 00000100:00100000:0.0:1788587118.501705:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181977216 00000100:00100000:0.0:1788587118.501792:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 138 00000100:00100000:0.0:1788587118.501804:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:11314:x1875469181977216:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788587118.501950:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:11314:x1875469181977216:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 Request processed in 148us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587118.501959:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 138 00000100:00100000:1.0:1788587118.509970:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181977088 00000100:00100000:1.0:1788587118.509991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181977088 00000100:00100000:1.0:1788587118.510095:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:1.0:1788587118.510105:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:2360:x1875469181977088:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587118.510121:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587118.510146:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab893b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2926 expref: 15 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587118.510184:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:1.0:1788587118.510190:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587118.510270:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2360:x1875469181977088:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 166us (9915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587118.510278:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000001:00080000:1.0:1788587118.641874:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000040:00080000:2.0:1788587118.851131:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587118.851141:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587118.852119:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788587118.852132:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788587119.300404:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587119.620551:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208200064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587119.620629:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587119.620724:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208200064 00000100:00100000:1.0:1788587119.620731:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208200064 00000100:00100000:1.0:1788587119.620796:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587119.620805:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208200064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587119.620857:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587119.620908:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208200064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587119.620916:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788587119.620964:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208200064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587119.621238:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208200192:0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.621270:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587119.623252:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208200704:0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.623394:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587119.623449:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788587119.623458:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208200576:0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.623489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587119.623564:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208200320:0@lo:400:kworker.0 00000100:00080000:2.0:1788587119.623569:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587119.623595:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208200448:0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.623601:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587119.623640:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587119.623647:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208200192 00000100:00100000:1.0:1788587119.623656:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208200192 00000100:00100000:2.0:1788587119.623684:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208200576 00000100:00100000:2.0:1788587119.623689:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208200576 00000100:00100000:2.0:1788587119.623731:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208200320 00000100:00100000:2.0:1788587119.623734:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208200320 00000100:00100000:2.0:1788587119.623746:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208200448 00000100:00100000:2.0:1788587119.623748:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208200448 00000100:00100000:2.0:1788587119.623764:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788587119.623773:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208200576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587119.623881:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208200576:12345-0@lo:400:kworker.0 Request processed in 108us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587119.623886:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788587119.623898:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208200192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587119.623917:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788587119.623939:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208200192:12345-0@lo:400:kworker.0 Request processed in 44us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587119.623947:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788587119.623951:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788587119.623960:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208200320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.623983:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208200704 00000100:00100000:1.0:1788587119.623989:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208200704 00000100:00100000:2.0:1788587119.624007:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208200320:12345-0@lo:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587119.624015:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788587119.624024:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788587119.624045:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788587119.624052:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208200448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587119.624083:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208200448:12345-0@lo:400:kworker.0 Request processed in 31us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587119.624089:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1788587119.624104:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587119.624107:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587119.624142:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208200576:0@lo:400:kworker.0 00000100:00100000:2.0:1788587119.624154:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208200192:0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.624174:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208200704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587119.624195:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208200320:0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.624224:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208200704:12345-0@lo:400:kworker.0 Request processed in 149us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587119.624231:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208200448:0@lo:400:kworker.0 00000100:00100000:1.0:1788587119.624235:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788587119.624263:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208200704:0@lo:400:kworker.0 00000100:00100000:0.0:1788587120.131764:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587120.131991:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208200832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587120.132311:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587120.132656:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208200832 00000100:00100000:1.0:1788587120.132667:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208200832 00000100:00100000:1.0:1788587120.132720:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788587120.132739:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208200832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587120.132775:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587120.132829:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208200832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587120.132836:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587120.133209:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb58c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208200832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788587120.329233:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587120.780272:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587120.780353:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181977344 00000100:00100000:0.0:1788587120.780365:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181977344 00000100:00100000:0.0:1788587120.780463:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00100000:0.0:1788587120.780473:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:11357:x1875469181977344:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587120.780494:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587120.780517:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab893c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c292d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780583:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780598:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780611:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780626:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780644:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780652:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780890:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780899:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780906:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780924:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587120.780929:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780938:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780952:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:0.0:1788587120.780954:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587120.780959:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780965:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab893cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780976:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780989:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.780995:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.781000:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587120.781017:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.781023:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.781031:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8bac90439f00) 00010000:00010000:0.0:1788587120.781033:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587120.781036:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.781041:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab893d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.781333:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab893c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c292d expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.781345:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:0.0:1788587120.781347:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587120.781351:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab893c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c292d expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.781359:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98600, rc 0) 00000100:00100000:0.0:1788587120.781603:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:11357:x1875469181977344:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1130us (1340us total) trans 0 rc 301/301 00000100:00100000:0.0:1788587120.781612:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 139 00000100:00080000:2.0:1788587120.781773:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587120.800303:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587120.809174:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181977600 00000100:00100000:1.0:1788587120.809190:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181977600 00000100:00100000:1.0:1788587120.809271:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 140 00000100:00100000:1.0:1788587120.809296:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:11357:x1875469181977600:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1788587120.809358:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587120.809390:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab88d43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2766 expref: 13 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.809420:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:1.0:1788587120.809426:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587120.809635:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.809650:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.809659:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.809694:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 5 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.819483:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 5 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587120.819516:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb58c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208200960:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587120.819660:0:7662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587120.839729:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587120.839897:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181977728 00000100:00100000:3.0:1788587120.839907:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181977728 00010000:00010000:3.0:1788587120.839964:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 6 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587120.840016:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:3.0:1788587120.840027:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2361:x1875469181977728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587120.840042:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587120.840050:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 6 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.840066:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 6 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.840091:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:3.0:1788587120.840097:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.840109:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.840129:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.840149:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587120.840203:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2361:x1875469181977728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 177us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587120.840210:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00080000:2.0:1788587120.843802:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587120.849249:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8939b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c291f expref: 5 pid: 5852 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587120.849276:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb58c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208200960:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587120.849322:0:7662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.849333:0:7662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.849339:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.849369:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.849388:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587120.849401:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587120.852349:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788587120.852368:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.852378:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.852386:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.852391:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587120.852396:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.852404:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.852502:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968000) 00010000:00010000:0.0:1788587120.852505:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587120.852510:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587120.852517:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab893da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587120.852535:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077177223 reply state 00000000bb528804 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587120.852545:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587120.852669:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:11357:x1875469181977600:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 43371us (52373us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788587120.852679:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 140 00010000:00010000:3.0:1788587120.860412:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.860434:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.860442:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.860448:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587120.860453:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.860461:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.860480:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8baca1025700) 00010000:00010000:3.0:1788587120.860483:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587120.860489:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587120.860495:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab893e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587120.975746:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587120.977487:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181977856 00000100:00100000:2.0:1788587120.977502:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181977856 00000100:00100000:2.0:1788587120.977575:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 141 00000100:00100000:2.0:1788587120.977588:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:11365:x1875469181977856:12345-192.168.204.28@tcp:101:lctl.0 00010000:00010000:2.0:1788587120.977616:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587120.977641:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab893e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2934 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.977712:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab893ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.977728:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab893ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.977741:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab893ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587120.977776:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587120.977779:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587120.977799:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab893ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.977823:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab893e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2934 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.977888:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab893ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2934 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587120.977899:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:2.0:1788587120.977902:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587120.977940:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4000, rc 0) 00000100:00100000:2.0:1788587120.978016:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:11365:x1875469181977856:12345-192.168.204.28@tcp:101:lctl.0 Request processed in 431us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587120.978024:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 141 00000100:00100000:2.0:1788587121.037227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587121.037587:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181977984 00000100:00100000:1.0:1788587121.037599:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181977984 00000100:00100000:1.0:1788587121.037666:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 142 00000100:00100000:1.0:1788587121.037675:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:11371:x1875469181977984:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587121.037697:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587121.037718:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab893f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c293b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.037805:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.037821:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.037902:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.037921:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.037928:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.037936:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038055:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8940b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038063:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8940b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038070:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8940b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587121.038098:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788587121.038101:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587121.038125:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8940b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038137:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038144:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038543:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038551:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587121.038556:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038565:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038580:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:1.0:1788587121.038583:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587121.038589:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038595:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab893fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038612:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038618:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038624:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038628:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52aa00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587121.038631:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038653:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038662:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8baca1025a00) 00010000:00010000:1.0:1788587121.038664:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587121.038667:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038673:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038713:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab893f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c293b expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038728:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8940b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c293b expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.038736:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587121.038738:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788587121.038741:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52a800, rc 0) 00000100:00100000:1.0:1788587121.038995:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:11371:x1875469181977984:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1318us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587121.039015:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 142 00000100:00100000:1.0:1788587121.043520:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587121.043622:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181978240 00000100:00100000:0.0:1788587121.043635:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181978240 00000100:00100000:0.0:1788587121.043706:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 143 00000100:00100000:0.0:1788587121.043716:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+15:11371:x1875469181978240:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1788587121.043737:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587121.043756:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89412 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2942 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.043914:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.043929:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.043940:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.044008:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.044017:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.044024:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587121.047442:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788587121.047674:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047708:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047720:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047763:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047771:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047778:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047784:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587121.047788:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047796:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047809:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:0.0:1788587121.047812:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587121.047816:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047823:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89419 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587121.047837:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b9964ac5 reply state 000000001e2d8098 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587121.047893:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788587121.047932:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89412 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047948:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.047956:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439a00) 00010000:00010000:0.0:1788587121.047958:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587121.047961:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99800, rc 0) 00000100:00100000:0.0:1788587121.048044:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11371:x1875469181978240:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4329us (4536us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788587121.048054:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 143 00010000:00010000:0.0:1788587121.051446:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.051464:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.051473:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.051479:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587121.051484:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.051493:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.051534:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac90439f00) 00010000:00010000:0.0:1788587121.051537:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587121.051542:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587121.051549:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89420 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587121.055045:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587121.055593:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181978368 00000100:00100000:3.0:1788587121.055603:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181978368 00000100:00100000:3.0:1788587121.055674:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:3.0:1788587121.055684:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2361:x1875469181978368:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587121.055702:0:10779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587121.055722:0:10779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2949 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587121.055750:0:10779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587121.055786:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788587121.055790:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587121.055800:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 6 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.055819:0:10779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 6 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.055832:0:10779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587121.055918:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181978368:12345-192.168.204.28@tcp:101:bash.0 Request processed in 227us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587121.055925:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00080000:0.0:1788587121.056381:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587121.060809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.060940:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181978496 00000100:00100000:2.0:1788587121.060951:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181978496 00000100:00100000:2.0:1788587121.061021:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1788587121.061031:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:11371:x1875469181978496:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587121.061051:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587121.061071:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2950 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.061103:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.061112:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587121.061116:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587121.061122:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.061168:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.061184:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 7 pid: 10779 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587121.061468:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875469208201088:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587121.061581:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587121.065994:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587121.066132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181978624 00000100:00100000:1.0:1788587121.066143:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181978624 00010000:00010000:1.0:1788587121.066194:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 8 pid: 10779 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587121.066262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:1.0:1788587121.066272:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181978624:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587121.066287:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587121.066312:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 8 pid: 10779 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.066328:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 8 pid: 10779 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.066358:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587121.066362:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587121.066371:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.066383:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.066428:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587121.066442:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb58c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875469208201216:192.168.204.28@tcp:105: 00000100:00100000:1.0:1788587121.066541:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6300 going to sleep for 11 seconds 00010000:00010000:2.0:1788587121.067690:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db4b0bd7/0xc1a730b05ab89435 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2949 expref: 8 pid: 10779 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587121.067718:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875469208201088:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587121.067754:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587121.070409:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb58c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875469208201216:192.168.204.28@tcp:105: 00010000:00010000:3.0:1788587121.070449:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587121.070516:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181978624:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4245us (4531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587121.070528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00010000:00010000:2.0:1788587121.072346:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4a00, rc 0) 00000100:00100000:2.0:1788587121.072527:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:11371:x1875469181978496:12345-192.168.204.28@tcp:101:bash.0 Request processed in 11492us (11722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587121.072537:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:1.0:1788587121.077392:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.077493:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181978880 00000100:00100000:2.0:1788587121.077503:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181978880 00000100:00100000:2.0:1788587121.077602:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:2.0:1788587121.077613:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:11371:x1875469181978880:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1788587121.078048:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11371:x1875469181978880:12345-192.168.204.28@tcp:35:bash.0 Request processed in 435us (664us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788587121.078057:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788587121.189213:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.189398:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181979136 00000100:00100000:2.0:1788587121.189409:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181979136 00000100:00100000:2.0:1788587121.189479:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00100000:2.0:1788587121.189509:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11381:x1875469181979136:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587121.189541:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587121.189569:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2957 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587121.189680:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788587121.189883:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89443 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2957 expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.189902:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:2.0:1788587121.189918:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587121.190164:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2957 expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.190184:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4400, rc 0) 00000100:00100000:2.0:1788587121.190272:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11381:x1875469181979136:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 765us (1072us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788587121.190280:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 144 00000100:00100000:3.0:1788587121.199553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587121.199768:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181979392 00000100:00100000:0.0:1788587121.199787:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181979392 00000100:00100000:0.0:1788587121.199897:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:0.0:1788587121.199933:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11381:x1875469181979392:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587121.200634:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11381:x1875469181979392:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 723us (1091us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788587121.200644:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:3.0:1788587121.340598:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1788587121.348100:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587121.350092:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181979520 00000100:00100000:2.0:1788587121.350109:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181979520 00000100:00100000:2.0:1788587121.350205:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 145 00000100:00100000:2.0:1788587121.350217:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11387:x1875469181979520:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587121.350246:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587121.350270:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c295e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.350341:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.350371:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.350384:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587121.350421:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788587121.350425:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587121.350443:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.350469:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c295e expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.350489:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c295e expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.350497:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587121.350500:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587121.350504:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5e00, rc 0) 00000100:00100000:2.0:1788587121.350576:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:11387:x1875469181979520:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 361us (9990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587121.350584:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 145 00000100:00100000:3.0:1788587121.358514:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.359343:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181979776 00000100:00100000:2.0:1788587121.359356:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181979776 00000100:00100000:3.0:1788587121.359520:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 146 00000100:00100000:3.0:1788587121.359531:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:11387:x1875469181979776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587121.359552:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587121.359576:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab8945f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2965 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.359683:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.359698:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.359710:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587121.359722:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587121.364341:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab8945f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2965 expref: 24 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.364378:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2965 expref: 23 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.364411:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439a00) 00010000:00010000:3.0:1788587121.364414:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587121.364418:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587121.364565:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11387:x1875469181979776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 5033us (6060us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788587121.364574:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 146 00000100:00100000:3.0:1788587121.369360:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.369703:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181980032 00000100:00100000:2.0:1788587121.369713:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181980032 00000100:00100000:2.0:1788587121.369783:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 147 00000100:00100000:2.0:1788587121.369794:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11387:x1875469181980032:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587121.369834:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587121.369895:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c296c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.370234:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8947b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.370252:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8947b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.370265:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8947b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587121.370278:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788587121.370397:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c296c expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.370418:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8947b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c296c expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.370428:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439a00) 00010000:00010000:2.0:1788587121.370431:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587121.370434:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5c00, rc 0) 00000100:00100000:2.0:1788587121.370494:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:11387:x1875469181980032:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 702us (1144us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788587121.370502:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 147 00000100:00100000:1.0:1788587121.379749:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587121.381081:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181980160 00000100:00100000:3.0:1788587121.381097:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181980160 00000100:00100000:3.0:1788587121.381197:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788587121.381208:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:2359:x1875469181980160:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587121.381225:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587121.381251:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2965 expref: 25 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.381273:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439a00) 00010000:00010000:3.0:1788587121.381278:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587121.381348:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:2359:x1875469181980160:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 142us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587121.381356:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788587121.391741:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.391900:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181980288 00000100:00100000:2.0:1788587121.391911:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181980288 00000100:00100000:2.0:1788587121.391987:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:2.0:1788587121.392017:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181980288:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:2.0:1788587121.392064:0:10779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.392085:0:10779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.392094:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587121.392098:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587121.392103:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.392141:0:10779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.392167:0:10779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 6 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587121.392181:0:10779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10779:1875469208201344:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587121.392281:0:10779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587121.405487:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587121.406288:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181980416 00000100:00100000:3.0:1788587121.406300:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181980416 00002000:00100000:3.0:1788587121.406355:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8bacbbcc8a80 x1875469181980416/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:437/0 lens 504/0 e 0 to 0 dl 1788587132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587121.406384:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacbbcc8a80 with x1875469181980416 ext(0->12) 00010000:00010000:3.0:1788587121.406394:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 7 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.406412:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 7 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587121.406419:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacbbcc8a80 00000100:00100000:3.0:1788587121.406456:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:3.0:1788587121.406465:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181980416:12345-192.168.204.28@tcp:4:lfs.0 00000100:00100000:3.0:1788587121.407565:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2362:x1875469181980416:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 1094us (2085us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788587121.407576:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00002000:00100000:3.0:1788587121.407586:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8bacbbcc8a80 x1875469181980416/t4294967305(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:437/0 lens 504/448 e 0 to 0 dl 1788587132 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587121.407596:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacbbcc8a80 with x1875469181980416 ext(0->12) 00010000:00010000:3.0:1788587121.407605:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 9 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.407623:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 9 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587121.407631:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacbbcc8a80 00000100:00100000:2.0:1788587121.407874:0:10779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10779:1875469208201344:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587121.407898:0:10779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587121.432720:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587121.432960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181980544 00000100:00100000:3.0:1788587121.433002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181980544 00010000:00010000:3.0:1788587121.433050:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 9 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587121.433100:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:3.0:1788587121.433112:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2362:x1875469181980544:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587121.433130:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788587121.433296:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788587121.433300:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788587120 00002000:00010000:3.0:1788587121.433302:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788587121 00002000:00010000:3.0:1788587121.433305:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788587120 00010000:00010000:3.0:1788587121.433315:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 9 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.433331:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 9 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.433358:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951b9172/0xc1a730b05ab8943c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2950 expref: 9 pid: 6707 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.433379:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587121.433383:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587121.433392:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.433402:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.433462:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587121.433736:0:10779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433767:0:10779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433793:0:10779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433802:0:10779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433810:0:10779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433817:0:10779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587121.433822:0:10779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433831:0:10779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433878:0:10779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.433886:0:10779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000924fce4b/0xc1a730b05ab89489 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587121.434030:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181980544:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 918us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587121.434039:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:2.0:1788587121.449399:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469181980288:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 57369us (57656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587121.449413:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:1.0:1788587121.466253:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.466417:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181980800 00000100:00100000:2.0:1788587121.466428:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181980800 00000100:00100000:2.0:1788587121.466478:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:2.0:1788587121.466487:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84661450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11387:x1875469181980800:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:2.0:1788587121.466565:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8947b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c296c expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587121.466817:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1788587121.466891:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788587121.467472:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1788587121.467535:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.467550:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.467560:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.467596:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.467612:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 28 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587121.467640:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208201472:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587121.467744:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587121.473746:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587121.474088:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181980928 00000100:00100000:3.0:1788587121.474098:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181980928 00010000:00010000:3.0:1788587121.474150:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 29 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587121.474195:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:3.0:1788587121.474205:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88343c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:2361:x1875469181980928:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587121.474221:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587121.474228:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 29 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.474241:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 29 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.474266:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439a00) 00010000:00010000:3.0:1788587121.474272:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.474281:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.474289:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.474324:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587121.474394:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88343c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:2361:x1875469181980928:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 190us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587121.474401:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00010000:00010000:2.0:1788587121.476462:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2942 expref: 28 pid: 5851 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587121.476487:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208201472:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587121.476513:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.476523:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.476541:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587121.476681:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788587121.476986:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788587121.477121:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208201600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788587121.477202:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587121.477242:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587121.477285:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208201600 00000100:00100000:0.0:1788587121.477293:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208201600 00000100:00100000:0.0:1788587121.477363:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587121.477372:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208201600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788587121.477449:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208201600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587121.477456:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788587121.477645:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587121.477673:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208201600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788587121.479124:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788587121.479285:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208201728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788587121.479340:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587121.479421:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587121.495708:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208201728 00000100:00100000:0.0:1788587121.495744:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208201728 00000100:00100000:1.0:1788587121.496175:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587121.496190:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208201728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587121.496514:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875469208201728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 328us (17172us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788587121.496522:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788587121.496687:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf2b5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208201728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788587121.496786:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788587121.496837:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.496887:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.496896:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.496921:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587121.496926:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.496935:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.496952:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439a00) 00010000:00010000:2.0:1788587121.496955:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788587121.496960:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.496966:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89490 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587121.497203:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788587121.497306:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788587121.497318:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443701474250ns, next at 444701472336ns, rc = 0 00000001:00080000:2.0:1788587121.497324:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788587121.497356:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439a00) 00010000:00010000:2.0:1788587121.497372:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788587121.497379:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8947b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c296c expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587121.497485:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84661450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:11387:x1875469181980800:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 30999us (31241us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788587121.497494:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00000020:00080000:2.0:1788587121.497498:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788587121.503927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587121.506493:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181981056 00000100:00100000:1.0:1788587121.506516:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181981056 00000100:00100000:1.0:1788587121.506620:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:1.0:1788587121.506632:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:11387:x1875469181981056:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587121.506664:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587121.506696:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89497 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2973 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.506768:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89497 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2973 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.506785:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89497 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2973 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.506805:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587121.506808:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587121.506813:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf52aa00, rc 0) 00000100:00100000:1.0:1788587121.506932:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:11387:x1875469181981056:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 302us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587121.506960:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 148 00000100:00100000:1.0:1788587121.519385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.519471:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181981312 00000100:00100000:2.0:1788587121.519482:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181981312 00000100:00100000:2.0:1788587121.519554:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:2.0:1788587121.519564:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:11387:x1875469181981312:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587121.519817:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:11387:x1875469181981312:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 254us (444us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788587121.519825:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:0.0:1788587121.633247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.633346:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181981568 00000100:00100000:2.0:1788587121.633356:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181981568 00000100:00100000:2.0:1788587121.633418:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00100000:2.0:1788587121.633430:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+33:11397:x1875469181981568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587121.633456:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587121.633477:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8949e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c297a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587121.633584:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788587121.633712:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8949e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c297a expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.633749:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:2.0:1788587121.633752:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587121.633758:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8949e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c297a expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587121.633774:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5c00, rc 0) 00000100:00100000:2.0:1788587121.633912:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11397:x1875469181981568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 485us (678us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788587121.633920:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 149 00000100:00100000:0.0:1788587121.638945:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587121.639044:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181981696 00000100:00100000:1.0:1788587121.639054:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181981696 00000100:00100000:1.0:1788587121.639117:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 150 00000100:00100000:1.0:1788587121.639127:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11397:x1875469181981696:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:1.0:1788587121.639214:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639229:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639240:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639252:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639258:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639263:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639343:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639350:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639357:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587121.639414:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639428:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639434:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639439:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639444:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587121.639448:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639455:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639467:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587121.639470:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587121.639476:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639482:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639496:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639501:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639512:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639518:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587121.639521:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639527:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639548:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca1025f00) 00010000:00010000:1.0:1788587121.639551:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587121.639553:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639558:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab894b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639573:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639579:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639584:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639590:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587121.639593:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639609:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639617:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587121.639620:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587121.639623:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.639628:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab894ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587121.639714:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11397:x1875469181981696:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 588us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587121.639721:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 150 00000100:00100000:1.0:1788587121.642585:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.642721:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181981952 00000100:00100000:2.0:1788587121.642730:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181981952 00000100:00100000:2.0:1788587121.642792:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:2.0:1788587121.642803:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11397:x1875469181981952:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587121.643118:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:11397:x1875469181981952:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 316us (546us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788587121.643126:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:0.0:1788587121.692076:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587121.692198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587121.692357:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181982208 00000100:00100000:1.0:1788587121.692368:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181982208 00000100:00100000:1.0:1788587121.692456:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:1.0:1788587121.692467:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181982208:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587121.692560:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2360:x1875469181982208:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 95us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587121.692567:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00080000:0.0:1788587121.697291:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587121.701138:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181982080 00000100:00100000:2.0:1788587121.701169:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181982080 00000100:00100000:2.0:1788587121.701254:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 301 00000100:00100000:2.0:1788587121.701266:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181982080:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587121.701352:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85b72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469181982080:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 88us (9285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587121.701360:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 301 00000100:00100000:0.0:1788587121.730063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587121.730290:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181982464 00000100:00100000:3.0:1788587121.730301:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181982464 00000100:00100000:3.0:1788587121.730363:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 151 00000100:00100000:3.0:1788587121.730374:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:11400:x1875469181982464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587121.730397:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587121.730419:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab894c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2981 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730497:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730513:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730526:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730554:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730561:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730567:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730705:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730715:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.730723:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587121.730733:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587121.731141:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731230:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731237:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731243:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587121.731248:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731257:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731270:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587121.731272:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587121.731277:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731294:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab894c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731310:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731315:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731320:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731325:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587121.731327:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731333:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731340:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac987bc800) 00010000:00010000:3.0:1788587121.731343:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587121.731345:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731351:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731397:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab894c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731412:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587121.731425:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587121.731427:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587121.731430:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051200, rc 0) 00000100:00100000:3.0:1788587121.731486:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:11400:x1875469181982464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1115us (1435us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788587121.731494:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 151 00000100:00100000:0.0:1788587121.746722:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587121.747082:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181982592 00000100:00100000:1.0:1788587121.747392:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181982592 00000100:00100000:1.0:1788587121.747517:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 152 00000100:00100000:1.0:1788587121.747529:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:11400:x1875469181982592:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:1.0:1788587121.747616:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747655:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747668:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747698:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747705:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747712:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747718:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587121.747722:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747728:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747740:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587121.747744:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587121.747749:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587121.747756:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab894e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587121.747909:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:11400:x1875469181982592:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 383us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587121.747924:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 152 00000100:00100000:1.0:1788587121.751252:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587121.751315:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181982848 00000100:00100000:2.0:1788587121.751338:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181982848 00000100:00100000:2.0:1788587121.751394:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:2.0:1788587121.751403:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:11400:x1875469181982848:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587121.751696:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:11400:x1875469181982848:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 293us (452us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788587121.751704:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1788587122.192027:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587122.192066:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181983104 00000100:00100000:3.0:1788587122.192077:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181983104 00000100:00080000:3.0:1788587122.192108:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587122.192515:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:3.0:1788587122.192535:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:11431:x1875469181983104:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:3.0:1788587122.192566:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587122.192588:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab894eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2988 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.192699:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.192714:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.192730:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587122.192753:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587122.193049:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab894eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2988 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.193085:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2988 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.193094:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587122.193097:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587122.193102:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050200, rc 0) 00000100:00100000:3.0:1788587122.193371:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:11431:x1875469181983104:12345-192.168.204.28@tcp:101:cat.0 Request processed in 845us (1352us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788587122.193380:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 153 00000100:00100000:1.0:1788587122.204075:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587122.204252:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181983360 00000100:00100000:2.0:1788587122.204265:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181983360 00000100:00100000:2.0:1788587122.204334:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:2.0:1788587122.204345:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:11431:x1875469181983360:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:1.0:1788587122.204712:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587122.204749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181983488 00000100:00100000:1.0:1788587122.204754:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181983488 00000100:00100000:1.0:1788587122.204791:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1788587122.204799:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:2361:x1875469181983488:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587122.204810:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587122.204833:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab894f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2988 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.204884:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587122.204890:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587122.205503:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:11431:x1875469181983360:12345-192.168.204.28@tcp:35:cat.0 Request processed in 1157us (1442us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788587122.205513:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:0.0:1788587122.209438:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:2361:x1875469181983488:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 4613us (4699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587122.209458:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000001:00080000:0.0:1788587122.239374:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788587122.239409:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1788587122.304915:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587122.305062:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181983744 00000100:00100000:3.0:1788587122.305072:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181983744 00000100:00100000:3.0:1788587122.305132:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00100000:3.0:1788587122.305154:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:11437:x1875469181983744:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:3.0:1788587122.305180:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587122.305183:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788587122.305885:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c295e expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.305917:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587122.305923:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587122.305943:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89500 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c298f expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.306070:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.306104:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.306114:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.306163:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.306179:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 40 pid: 5850 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587122.306193:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208201856:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587122.306312:0:7662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587122.311520:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587122.315293:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181983872 00000100:00100000:0.0:1788587122.315310:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181983872 00010000:00010000:0.0:1788587122.315369:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 41 pid: 5850 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587122.315428:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:0.0:1788587122.315438:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:2362:x1875469181983872:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587122.315455:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587122.315463:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 41 pid: 5850 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.315477:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 41 pid: 5850 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.315522:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:0.0:1788587122.315526:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.315537:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.315545:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.315566:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587122.315645:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+41:2362:x1875469181983872:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 208us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587122.315653:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00010000:00010000:3.0:1788587122.316209:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab894d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2981 expref: 40 pid: 5850 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587122.316228:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208201856:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587122.316249:0:7662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.316259:0:7662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.316264:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587122.316281:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788587122.316442:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89500 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 41 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.316458:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 40 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.316465:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587122.316468:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788587122.316470:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:3.0:1788587122.316504:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:11437:x1875469181983744:12345-192.168.204.28@tcp:101:dd.0 Request processed in 11354us (11601us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788587122.316511:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 154 00000100:00100000:2.0:1788587122.321593:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587122.323196:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181984128 00000100:00100000:0.0:1788587122.323311:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181984128 00000100:00100000:0.0:1788587122.323388:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 155 00000100:00100000:0.0:1788587122.323400:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:11437:x1875469181984128:12345-192.168.204.28@tcp:36:dd.0 00010000:00010000:0.0:1788587122.323702:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.323722:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.323750:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587122.323810:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788587122.323878:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000597c1ed9 reply state 0000000084ed5345 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587122.323912:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587122.324038:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:11437:x1875469181984128:12345-192.168.204.28@tcp:36:dd.0 Request processed in 639us (2458us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788587122.324046:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 155 00000020:00080000:0.0:1788587122.324053:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587122.326802:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.326819:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.326827:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.326833:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587122.326838:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.326893:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.326911:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587122.326914:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587122.326936:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.326942:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89515 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.373418:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587122.663682:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587122.665251:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181984256 00000100:00100000:1.0:1788587122.665268:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181984256 00000100:00100000:1.0:1788587122.665357:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 156 00000100:00100000:1.0:1788587122.665376:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+42:11451:x1875469181984256:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:1.0:1788587122.665404:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587122.665437:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8951c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2996 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665502:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665534:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665552:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665568:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665575:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665581:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665686:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665698:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 43 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665707:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665758:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 43 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587122.665775:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 43 pid: 7662 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587122.666206:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208201984:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587122.666348:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587122.672393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587122.675031:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208201984:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587122.675066:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587122.677101:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181984512 00000100:00100000:3.0:1788587122.677115:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181984512 00000100:00100000:3.0:1788587122.677265:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:3.0:1788587122.677277:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:5602:x1875469181984512:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788587122.677634:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:5602:x1875469181984512:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 358us (5251us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788587122.677642:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:2.0:1788587122.690653:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587122.691593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181984640 00000100:00100000:3.0:1788587122.691606:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181984640 00010000:00010000:3.0:1788587122.691659:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 45 pid: 7662 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587122.691707:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:3.0:1788587122.691717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:2362:x1875469181984640:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587122.691741:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587122.691749:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 45 pid: 7662 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.691763:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 45 pid: 7662 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.691786:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89507 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c298f expref: 45 pid: 7662 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.691826:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587122.692233:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.692247:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.692255:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587122.692292:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587122.692347:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:2362:x1875469181984640:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 632us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587122.692355:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00010000:00010000:2.0:1788587122.694387:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694403:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587122.694477:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788587122.694482:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587122.694507:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694541:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694550:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694556:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694563:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694568:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52bc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587122.694572:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694579:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694593:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587122.694595:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587122.694599:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694605:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52bc00/0xc1a730b05ab89523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694619:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694626:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694638:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694642:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587122.694645:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694652:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694659:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca1025f00) 00010000:00010000:2.0:1788587122.694660:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587122.694663:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694669:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b600/0xc1a730b05ab8952a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694711:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b200/0xc1a730b05ab8951c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2996 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694726:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2996 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587122.694734:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:2.0:1788587122.694736:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587122.694739:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4600, rc 0) 00000100:00100000:2.0:1788587122.694822:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:11451:x1875469181984256:12345-192.168.204.28@tcp:101:stat.0 Request processed in 29447us (31150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587122.694890:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 156 00000100:00100000:2.0:1788587122.798983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587122.799370:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181984896 00000100:00100000:0.0:1788587122.799380:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181984896 00000100:00100000:0.0:1788587122.799445:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 157 00000100:00100000:0.0:1788587122.799455:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:11457:x1875469181984896:12345-192.168.204.28@tcp:36:truncate.0 00010000:00010000:0.0:1788587122.799518:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587122.799553:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab89531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2996 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.799573:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:0.0:1788587122.799578:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587122.800325:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.800342:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.800352:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788587122.800409:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788587122.800434:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019498eb3 reply state 000000009ad989cd transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587122.800463:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587122.800579:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:11457:x1875469181984896:12345-192.168.204.28@tcp:36:truncate.0 Request processed in 1122us (1614us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788587122.800586:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 157 00000020:00080000:0.0:1788587122.800591:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788587122.806063:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.806084:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.806091:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.806097:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587122.806232:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.806243:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.806261:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:0.0:1788587122.806264:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587122.806269:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587122.806276:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab89538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587123.092513:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.092752:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181985024 00000100:00100000:3.0:1788587123.092762:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181985024 00000100:00100000:3.0:1788587123.092899:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00100000:3.0:1788587123.092910:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:11471:x1875469181985024:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:3.0:1788587123.092936:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587123.092971:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab8953f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c299d expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093057:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093073:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093104:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093132:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093140:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093146:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093229:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093237:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093243:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587123.093281:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788587123.093284:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587123.093304:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093314:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093322:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093337:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093343:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093348:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587123.093352:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093359:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093370:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587123.093373:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587123.093378:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093384:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89546 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093397:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093403:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093408:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093413:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587123.093421:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093428:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093436:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac987bc800) 00010000:00010000:3.0:1788587123.093439:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587123.093442:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093447:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8954d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093481:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab8953f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 46 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093494:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 45 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.093500:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587123.093503:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587123.093505:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050e00, rc 0) 00000100:00100000:3.0:1788587123.093581:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:11471:x1875469181985024:12345-192.168.204.28@tcp:101:stat.0 Request processed in 673us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.093588:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 158 00000100:00100000:2.0:1788587123.279063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.279190:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181985280 00000100:00100000:3.0:1788587123.279201:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181985280 00000100:00100000:3.0:1788587123.279283:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:3.0:1788587123.279294:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+45:11481:x1875469181985280:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587123.279331:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587123.279354:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab8955b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29a4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587123.279462:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788587123.279755:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab8955b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29a4 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.279771:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:3.0:1788587123.279775:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587123.279780:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab8955b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29a4 expref: 47 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.279796:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:3.0:1788587123.280132:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+46:11481:x1875469181985280:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 838us (1077us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788587123.280140:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 159 00000100:00100000:0.0:1788587123.290970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.291224:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181985536 00000100:00100000:3.0:1788587123.291234:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181985536 00000100:00100000:3.0:1788587123.291295:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:3.0:1788587123.291306:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84662850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+46:11481:x1875469181985536:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1788587123.291579:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84662850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:11481:x1875469181985536:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 273us (627us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788587123.291587:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:2.0:1788587123.392664:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587123.392789:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181985792 00000100:00100000:1.0:1788587123.392812:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181985792 00000100:00100000:1.0:1788587123.392945:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 160 00000100:00100000:1.0:1788587123.392969:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+47:11487:x1875469181985792:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587123.392993:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587123.393025:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89569 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29ab expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.393129:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.393146:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 48 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.393156:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.393192:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 48 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.393207:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 48 pid: 7662 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587123.393234:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208202112:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587123.393340:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6840 going to sleep for 11 seconds 00010000:00010000:0.0:1788587123.397832:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587123.404699:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.405136:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181985920 00000100:00100000:3.0:1788587123.405147:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181985920 00010000:00010000:3.0:1788587123.405190:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 49 pid: 7662 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587123.405268:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:3.0:1788587123.405280:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:2362:x1875469181985920:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587123.405296:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587123.405304:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 49 pid: 7662 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.405318:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 49 pid: 7662 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.405343:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587123.405349:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.405358:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.405366:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.405386:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587123.405449:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+49:2362:x1875469181985920:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 172us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.405457:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00010000:00010000:1.0:1788587123.411450:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c299d expref: 48 pid: 7662 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587123.411479:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208202112:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587123.411508:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.411519:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.411525:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587123.411548:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788587123.411751:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89569 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.411767:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.411777:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587123.411779:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788587123.411783:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5800, rc 0) 00000100:00100000:1.0:1788587123.412000:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:11487:x1875469181985792:12345-192.168.204.28@tcp:101:bash.0 Request processed in 19044us (19347us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788587123.412023:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 160 00000100:00100000:0.0:1788587123.419289:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587123.419405:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181986176 00000100:00100000:2.0:1788587123.419417:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181986176 00000100:00100000:2.0:1788587123.419483:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 161 00000100:00100000:2.0:1788587123.419494:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:11487:x1875469181986176:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1788587123.420116:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587123.420135:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587123.420147:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587123.420200:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788587123.420302:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fdadc31 reply state 00000000c951e339 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587123.420310:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587123.420451:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:11487:x1875469181986176:12345-192.168.204.28@tcp:36:bash.0 Request processed in 957us (1385us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788587123.420459:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 161 00000020:00080000:2.0:1788587123.420464:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587123.429165:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.429186:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.429214:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.429221:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587123.429226:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.429235:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.429253:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587123.429257:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587123.429263:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.429271:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8957e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587123.439173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.439587:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181986304 00000100:00100000:3.0:1788587123.439599:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181986304 00000100:00100000:3.0:1788587123.439660:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 162 00000100:00100000:3.0:1788587123.439671:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:11487:x1875469181986304:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587123.439695:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587123.439726:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29b2 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.439809:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.439823:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.439887:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.439922:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.439936:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 51 pid: 5852 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587123.439950:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208202240:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587123.440048:0:7662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbc9b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587123.443293:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208202240:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587123.443325:0:7662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587123.445191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.446775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181986432 00000100:00100000:3.0:1788587123.446792:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181986432 00010000:00010000:3.0:1788587123.447058:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 52 pid: 5852 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587123.447110:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:3.0:1788587123.447122:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:2361:x1875469181986432:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587123.447139:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587123.447147:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 52 pid: 5852 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.447180:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 52 pid: 5852 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.447332:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89570 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ab expref: 52 pid: 5852 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.447350:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587123.447355:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.447365:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.447373:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.447414:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587123.447482:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:2361:x1875469181986432:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 363us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.447490:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00010000:00010000:1.0:1788587123.447577:0:7662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.447586:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587123.447635:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788587123.447639:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587123.447661:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.447693:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29b2 expref: 51 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.447710:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29b2 expref: 50 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.447732:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587123.447736:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587123.447739:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051200, rc 0) 00000100:00100000:1.0:1788587123.447767:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:11487:x1875469181986304:12345-192.168.204.28@tcp:101:bash.0 Request processed in 8098us (8604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587123.447774:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 162 00000100:00100000:2.0:1788587123.451632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.451701:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181986688 00000100:00100000:3.0:1788587123.451711:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181986688 00000100:00100000:3.0:1788587123.451834:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:3.0:1788587123.452107:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:11487:x1875469181986688:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:3.0:1788587123.452369:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:11487:x1875469181986688:12345-192.168.204.28@tcp:35:bash.0 Request processed in 525us (748us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788587123.452378:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:2.0:1788587123.577086:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.577204:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181986944 00000100:00100000:3.0:1788587123.577214:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181986944 00000100:00100000:3.0:1788587123.577273:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00100000:3.0:1788587123.577283:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:11497:x1875469181986944:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587123.577308:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587123.577330:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29b9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587123.577428:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788587123.577550:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89593 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29b9 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.577564:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:3.0:1788587123.577567:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587123.577572:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29b9 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.577587:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587123.577782:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11497:x1875469181986944:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 498us (706us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788587123.577789:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 163 00000100:00100000:0.0:1788587123.589749:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587123.589868:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181987072 00000100:00100000:1.0:1788587123.589879:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181987072 00000100:00100000:1.0:1788587123.589938:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 164 00000100:00100000:1.0:1788587123.589948:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11497:x1875469181987072:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:1.0:1788587123.590053:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590070:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590082:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590098:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590106:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590112:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590196:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590204:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590212:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587123.590251:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590265:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590285:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590292:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590297:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587123.590302:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590310:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590322:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587123.590324:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587123.590329:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590335:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab895a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590347:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590353:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590358:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590363:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587123.590372:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590379:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590387:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca1025600) 00010000:00010000:1.0:1788587123.590389:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587123.590392:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590398:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab895a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590413:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590418:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590424:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590429:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587123.590432:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590437:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590444:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587123.590446:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587123.590455:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.590461:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587123.590543:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5946680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11497:x1875469181987072:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 597us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587123.590551:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 164 00000100:00100000:0.0:1788587123.592802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587123.593076:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181987328 00000100:00100000:2.0:1788587123.593089:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181987328 00000100:00100000:2.0:1788587123.593150:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:2.0:1788587123.593161:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11497:x1875469181987328:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587123.593421:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:11497:x1875469181987328:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 262us (630us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788587123.593429:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:2.0:1788587123.661688:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.662978:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181987584 00000100:00100000:3.0:1788587123.662993:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181987584 00000100:00100000:3.0:1788587123.663067:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 165 00000100:00100000:3.0:1788587123.663077:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+53:11500:x1875469181987584:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587123.663104:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587123.663127:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab895b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29c0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663550:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663566:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663577:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663591:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663598:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663605:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663787:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab895cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663797:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab895cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.663805:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab895cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587123.663816:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788587123.664192:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664200:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664216:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664222:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587123.664226:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664234:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664247:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587123.664250:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587123.664256:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664263:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab895bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664277:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664284:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664289:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664294:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587123.664297:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664312:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664320:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac987bc800) 00010000:00010000:3.0:1788587123.664322:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587123.664325:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664330:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab895c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664373:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab895b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29c0 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664386:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab895cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29c0 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.664393:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587123.664395:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587123.664397:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051600, rc 0) 00000100:00100000:3.0:1788587123.664519:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:11500:x1875469181987584:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1442us (2841us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788587123.664527:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 165 00000100:00100000:0.0:1788587123.680102:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587123.680217:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.680295:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181987840 00000100:00100000:3.0:1788587123.680307:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181987840 00000100:00100000:3.0:1788587123.680373:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1788587123.680384:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:2360:x1875469181987840:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587123.680420:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587123.680447:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab895cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29c0 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.680466:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587123.680471:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587123.680532:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:2360:x1875469181987840:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 150us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.680538:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788587123.684881:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181987712 00000100:00100000:1.0:1788587123.684902:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181987712 00000100:00100000:1.0:1788587123.684993:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 166 00000100:00100000:1.0:1788587123.685012:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:11500:x1875469181987712:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:1.0:1788587123.685345:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685365:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685376:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685405:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685412:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685420:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685426:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587123.685446:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685458:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685473:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:1.0:1788587123.685476:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788587123.685481:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.685488:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab895d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587123.685584:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:11500:x1875469181987712:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 579us (5491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587123.685592:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 166 00000100:00100000:3.0:1788587123.688036:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587123.688165:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181988096 00000100:00100000:2.0:1788587123.688177:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181988096 00000100:00100000:2.0:1788587123.688232:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:2.0:1788587123.688243:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:11500:x1875469181988096:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587123.688463:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:11500:x1875469181988096:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 221us (437us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788587123.688470:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000001:00080000:3.0:1788587123.773589:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967446 is committed 00000001:00080000:3.0:1788587123.773617:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000001:00080000:3.0:1788587123.773627:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:3.0:1788587123.773648:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788587123.773673:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bac91a53300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788587123.773678:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac88f7c600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bac91a53000 00000020:00080000:3.0:1788587123.773681:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac88f7c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bacb4b8d800 00000020:00080000:3.0:1788587123.773751:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788587123.774024:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788587123.774397:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587123.774419:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208202368:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788587123.774486:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587123.774557:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208202368 00000100:00100000:2.0:1788587123.774564:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208202368 00000100:00100000:2.0:1788587123.774620:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788587123.774629:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208202368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788587123.774656:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1788587123.774686:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bac70, atime: 0x6a9bac71, ctime: 0x6a9bac70, blocks: 0xb 00010000:00010000:2.0:1788587123.774694:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587123.774740:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1788587123.774745:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587123.774752:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587123.774769:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587123.774780:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587123.774788:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587123.774806:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788587123.775608:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208202368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 978us (1119us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788587123.775618:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788587123.775648:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587123.775683:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788587123.775689:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788587123.776174:0:3314:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bacbf98df80 x1875469208202368/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587139 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788587123.776188:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bacbf98df80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788587123.776193:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208202368:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788587123.776555:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587123.776565:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.776577:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587123.776582:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.776593:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.776612:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.776626:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000814a5c5a/0xc1a730b05ab895e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587123.776646:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587123.776648:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587123.776650:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587123.911432:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587123.911547:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181988352 00000100:00100000:0.0:1788587123.911556:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181988352 00000100:00100000:0.0:1788587123.911618:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:0.0:1788587123.911628:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+16:11518:x1875469181988352:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1788587123.911653:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587123.911674:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab895e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587123.911785:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab895ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587123.911811:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab895ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587123.911825:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab895ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587123.911836:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788587123.912135:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab895e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29c7 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587123.912169:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab895ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29c7 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587123.912177:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:0.0:1788587123.912180:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788587123.912183:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98200, rc 0) 00000100:00100000:0.0:1788587123.912516:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11518:x1875469181988352:12345-192.168.204.28@tcp:101:cat.0 Request processed in 889us (1095us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788587123.912524:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 167 00000100:00100000:1.0:1788587123.949625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.950146:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181988480 00000100:00100000:3.0:1788587123.950158:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181988480 00000100:00100000:3.0:1788587123.950232:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:3.0:1788587123.950244:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11519:x1875469181988480:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587123.950275:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587123.950299:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab895fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29ce expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.950393:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.950409:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.950421:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587123.950457:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788587123.950460:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587123.950478:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.950508:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab895fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ce expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.950530:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ce expref: 19 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.950540:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587123.950543:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587123.950547:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587123.950613:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11519:x1875469181988480:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 372us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.950620:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 168 00000100:00100000:2.0:1788587123.960788:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.961022:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181988864 00000100:00100000:3.0:1788587123.961034:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181988864 00000100:00100000:3.0:1788587123.961116:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:3.0:1788587123.961125:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11519:x1875469181988864:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1788587123.961476:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11519:x1875469181988864:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 352us (700us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788587123.961484:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1788587123.970729:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587123.971324:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181988992 00000100:00100000:3.0:1788587123.971336:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181988992 00000100:00100000:3.0:1788587123.971406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1788587123.971416:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88342050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11519:x1875469181988992:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:3.0:1788587123.971432:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788587123.971459:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8958c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29b2 expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.971481:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab895ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29c7 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.971494:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52aa00/0xc1a730b05ab89497 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2973 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587123.971505:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025a00) 00010000:00010000:3.0:1788587123.971517:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587123.971577:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88342050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:11519:x1875469181988992:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 163us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587123.971584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1788587123.974271:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587123.974365:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181989120 00000100:00100000:0.0:1788587123.974376:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181989120 00000100:00100000:0.0:1788587123.974431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:0.0:1788587123.974442:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:11519:x1875469181989120:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:0.0:1788587123.974540:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587123.974556:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587123.974568:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587123.974938:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788587123.975340:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:11519:x1875469181989120:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 898us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587123.975350:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 169 00000100:00100000:2.0:1788587124.007322:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587124.007414:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181989248 00000100:00100000:3.0:1788587124.007426:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181989248 00000100:00100000:3.0:1788587124.007506:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 170 00000100:00100000:3.0:1788587124.007539:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:11521:x1875469181989248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587124.007560:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587124.007584:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29d5 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.007650:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.007666:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.007677:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.007691:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.007697:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.007702:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788587124.007919:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788587124.008601:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.008612:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.008621:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587124.008670:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788587124.008674:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587124.008696:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009653:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009669:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009677:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009686:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009692:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587124.009698:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009720:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009735:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587124.009737:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587124.009743:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009749:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab89618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009782:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009799:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009805:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009810:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587124.009814:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009820:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009828:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac987bc800) 00010000:00010000:3.0:1788587124.009830:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587124.009833:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009839:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab8961f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009920:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 19 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009936:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587124.009966:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439200) 00010000:00010000:3.0:1788587124.009968:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587124.009971:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051800, rc 0) 00000100:00100000:3.0:1788587124.010053:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11521:x1875469181989248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2515us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.010062:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 170 00010000:00010000:0.0:1788587124.422954:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587124.740050:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208202496:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740126:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.740168:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208203008:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740190:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.740221:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788587124.740227:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208202624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740249:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.740268:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208203136:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740290:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587124.740324:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208203008 00000100:00100000:1.0:1788587124.740331:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208203008 00000100:00100000:1.0:1788587124.740391:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208202624 00000100:00100000:1.0:1788587124.740394:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208202624 00000100:00100000:1.0:1788587124.740410:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788587124.740417:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208203008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740465:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208203008:12345-0@lo:400:kworker.0 Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.740483:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788587124.740499:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788587124.740503:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208202624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740526:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208202624:12345-0@lo:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.740531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788587124.740548:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208203136 00000100:00100000:1.0:1788587124.740551:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208203136 00000100:00100000:1.0:1788587124.740570:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587124.740575:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208203136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740598:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208203136:12345-0@lo:400:kworker.0 Request processed in 24us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587124.740603:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587124.740635:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208202624:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740643:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208203136:0@lo:400:kworker.0 00000100:00100000:1.0:1788587124.740650:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208203008:0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.740884:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208202880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.740922:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587124.740954:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788587124.740960:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208202752:0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.740983:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587124.740998:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208203264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587124.741017:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587124.741042:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208202752 00000100:00100000:3.0:1788587124.741045:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208202752 00000100:00100000:3.0:1788587124.741078:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587124.741084:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208202752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.741117:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208202752:12345-0@lo:400:kworker.0 Request processed in 34us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.741124:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788587124.741143:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208202880 00000100:00100000:3.0:1788587124.741147:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208202880 00000100:00100000:3.0:1788587124.741170:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788587124.741176:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208202880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.741205:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208202880:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.741219:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788587124.741250:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208203264 00000100:00100000:3.0:1788587124.741254:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208203264 00000100:00100000:3.0:1788587124.741280:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587124.741287:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208203264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587124.741314:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587124.741346:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208203264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.741351:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587124.741376:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208202752:0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.741391:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208203264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587124.741398:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208202880:0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.741457:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208202496 00000100:00100000:3.0:1788587124.741461:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208202496 00000100:00100000:3.0:1788587124.741485:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788587124.741491:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208202496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587124.741529:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208202496:12345-0@lo:400:kworker.0 Request processed in 38us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587124.741536:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788587124.741571:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208202496:0@lo:400:kworker.0 00000100:00080000:3.0:1788587124.741594:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587124.741600:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788587124.970819:0:12539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587124.970828:0:12539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587124.970985:0:12539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788587124.970993:0:12539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788587125.005591:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587125.005600:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587125.005662:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788587125.005670:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587125.005820:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbfadc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208203392:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587125.006289:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587125.013589:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbfadc700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208203392:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587125.020020:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.021622:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181989376 00000100:00100000:3.0:1788587125.021638:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181989376 00000100:00100000:3.0:1788587125.021709:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:3.0:1788587125.021719:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181989376:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788587125.021751:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788587125.021907:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181989376:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 190us (1895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.021915:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:2.0:1788587125.036899:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.037107:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181989504 00000100:00100000:0.0:1788587125.037117:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181989504 00000100:00100000:0.0:1788587125.037164:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:0.0:1788587125.037173:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181989504:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788587125.037254:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037272:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037285:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037300:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037307:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037313:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037339:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037347:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037352:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587125.037404:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788587125.037408:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587125.037421:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037431:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037437:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037444:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037450:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.037454:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037461:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037473:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:0.0:1788587125.037476:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587125.037480:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037486:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab8962d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037498:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037514:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037520:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037524:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.037527:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037533:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037541:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8bac90439e00) 00010000:00010000:0.0:1788587125.037543:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587125.037546:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037551:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89634 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037567:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037572:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037577:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037582:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.037592:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037599:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037606:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439200) 00010000:00010000:0.0:1788587125.037609:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587125.037612:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.037619:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab8963b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.037710:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181989504:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 537us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.037719:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:0.0:1788587125.064741:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.064884:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181989760 00000100:00100000:3.0:1788587125.064894:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181989760 00000100:00100000:3.0:1788587125.064969:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:3.0:1788587125.064980:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181989760:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587125.065001:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587125.065021:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89642 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29dc expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065121:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065135:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065147:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587125.065180:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788587125.065279:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065287:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065293:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065298:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587125.065302:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065310:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065322:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439200) 00010000:00010000:3.0:1788587125.065325:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587125.065329:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065336:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89649 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065376:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89642 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29dc expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065385:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:3.0:1788587125.065388:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587125.065398:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89642 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29dc expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.065407:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051200, rc 0) 00000100:00100000:3.0:1788587125.065465:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11532:x1875469181989760:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 487us (732us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788587125.065472:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 173 00000100:00100000:1.0:1788587125.078721:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.079494:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181989888 00000100:00100000:0.0:1788587125.079505:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181989888 00000100:00100000:0.0:1788587125.079568:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 174 00000100:00100000:0.0:1788587125.079578:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11532:x1875469181989888:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587125.079614:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587125.079726:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11532:x1875469181989888:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 149us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.079733:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 174 00000100:00100000:3.0:1788587125.083673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.084119:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181990144 00000100:00100000:0.0:1788587125.084132:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181990144 00000100:00100000:0.0:1788587125.084192:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:0.0:1788587125.084202:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11532:x1875469181990144:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587125.084233:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587125.084236:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788587125.084266:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ce expref: 19 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.084285:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:0.0:1788587125.084290:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587125.084305:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89657 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29e3 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788587125.085801:0:7662:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788587125.088257:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8965e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.088283:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8965e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.088297:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8965e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.088374:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89657 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29e3 expref: 21 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.088392:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8965e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29e3 expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.088402:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac90439e00) 00010000:00010000:0.0:1788587125.088405:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587125.088423:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587125.088514:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11532:x1875469181990144:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 4311us (4847us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788587125.088524:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 175 00000100:00100000:0.0:1788587125.095046:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.095957:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181990400 00000100:00100000:3.0:1788587125.095969:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181990400 00000100:00100000:3.0:1788587125.096026:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:3.0:1788587125.096036:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11532:x1875469181990400:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788587125.096104:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587125.096134:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8965e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29e3 expref: 20 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096151:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac90439e00) 00010000:00010000:3.0:1788587125.096162:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587125.096186:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096200:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096210:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096250:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096270:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096278:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096495:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096503:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096511:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096517:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587125.096521:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096669:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096682:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587125.096685:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587125.096689:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096696:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8966c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096710:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096723:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096729:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096734:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587125.096738:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096744:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096752:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x413b1ca6 (ffff8bac987bc800) 00010000:00010000:3.0:1788587125.096755:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587125.096758:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.096764:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x413b1ca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.098160:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11532:x1875469181990400:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 2116us (3118us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788587125.098171:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:1.0:1788587125.107493:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.107594:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181990528 00000100:00100000:3.0:1788587125.107605:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181990528 00000100:00100000:3.0:1788587125.107661:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:3.0:1788587125.107671:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11532:x1875469181990528:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587125.107700:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587125.107732:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8967a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29ea expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.107767:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.107782:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.107793:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.108158:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051600/0xc1a730b05ab8967a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.108180:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.108253:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:3.0:1788587125.108257:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788587125.108260:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587125.108326:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11532:x1875469181990528:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 656us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.108333:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:3.0:1788587125.110609:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.111080:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181990784 00000100:00100000:0.0:1788587125.111090:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181990784 00000100:00100000:0.0:1788587125.111150:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 178 00000100:00100000:0.0:1788587125.111162:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11532:x1875469181990784:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587125.111250:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.111268:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.111281:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587125.111665:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788587125.111675:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 447315831895ns, next at 448315829584ns, rc = 0 00000004:00010000:0.0:1788587125.111827:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c96c3ffc reply state 00000000d2cc31dc transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.112157:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587125.112355:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:11532:x1875469181990784:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 1194us (1752us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788587125.112364:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 178 00000100:00100000:2.0:1788587125.124646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587125.124695:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181990912 00000100:00100000:2.0:1788587125.124706:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181990912 00000100:00100000:2.0:1788587125.124760:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 179 00000100:00100000:2.0:1788587125.124770:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:11532:x1875469181990912:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587125.124794:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587125.124816:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29f1 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.125191:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 23 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.125207:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 23 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.125228:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:2.0:1788587125.125231:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587125.125236:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5200, rc 0) 00000100:00100000:2.0:1788587125.125291:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11532:x1875469181990912:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 522us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587125.125298:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 179 00010000:00010000:3.0:1788587125.125441:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.125450:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.125468:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.125474:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587125.125479:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.125486:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.125500:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:3.0:1788587125.125503:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587125.125507:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.125513:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab89688 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587125.128246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587125.128295:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181991040 00000100:00100000:2.0:1788587125.128305:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181991040 00000100:00100000:2.0:1788587125.128364:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:2.0:1788587125.128374:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181991040:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788587125.128744:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181991040:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 370us (507us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788587125.128752:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00080000:3.0:1788587125.129393:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587125.152269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.152339:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181991296 00000100:00100000:3.0:1788587125.152350:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181991296 00000100:00100000:3.0:1788587125.152415:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:3.0:1788587125.152426:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:11532:x1875469181991296:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587125.152658:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11532:x1875469181991296:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 233us (404us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788587125.152667:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:2.0:1788587125.155236:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.155312:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181991552 00000100:00100000:3.0:1788587125.155321:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181991552 00000100:00100000:3.0:1788587125.155389:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 180 00000100:00100000:3.0:1788587125.155413:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11532:x1875469181991552:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788587125.155519:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11532:x1875469181991552:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.155526:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 180 00000100:00100000:3.0:1788587125.164653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587125.164769:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181991680 00000100:00100000:1.0:1788587125.164780:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181991680 00000100:00100000:1.0:1788587125.164875:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 181 00000100:00100000:1.0:1788587125.164902:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11532:x1875469181991680:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587125.164935:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587125.164958:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29f8 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.165031:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5c00/0xc1a730b05ab8969d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.165046:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5c00/0xc1a730b05ab8969d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.165058:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5c00/0xc1a730b05ab8969d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587125.165328:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587125.165350:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5c00/0xc1a730b05ab8969d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.165378:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f8 expref: 25 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.165396:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5c00/0xc1a730b05ab8969d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f8 expref: 24 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.165405:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:1.0:1788587125.165408:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587125.165412:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5c00, rc 0) 00000100:00100000:1.0:1788587125.165472:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11532:x1875469181991680:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 573us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587125.165490:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 181 00000100:00100000:2.0:1788587125.174045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587125.174117:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181991808 00000100:00100000:1.0:1788587125.174128:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181991808 00000100:00100000:1.0:1788587125.174187:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1788587125.174197:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181991808:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587125.174215:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587125.174236:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c29ff expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587125.174269:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac74, blocks: 0x1 00010000:00010000:1.0:1788587125.174289:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=447s v=(0 0) 00010000:00010000:1.0:1788587125.174294:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587125.174304:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.174326:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.174340:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4800, rc 0) 00000100:00100000:1.0:1788587125.174399:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181991808:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 203us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587125.174406:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:3.0:1788587125.183773:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.184093:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181992064 00000100:00100000:0.0:1788587125.184104:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181992064 00000100:00100000:0.0:1788587125.184182:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 182 00000100:00100000:0.0:1788587125.184192:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11532:x1875469181992064:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587125.184301:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5945180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11532:x1875469181992064:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 110us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.184309:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 182 00000100:00100000:1.0:1788587125.189987:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.190087:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181992192 00000100:00100000:3.0:1788587125.190097:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181992192 00000100:00100000:3.0:1788587125.190149:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:3.0:1788587125.190160:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:11532:x1875469181992192:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587125.190178:0:6708:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587125.190196:0:6708:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a06 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.190230:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.190240:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587125.190244:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587125.190251:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 9 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.190289:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.190304:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 9 pid: 6706 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.190337:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208203520:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587125.190423:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587125.196347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587125.196441:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181992320 00000100:00100000:1.0:1788587125.196455:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181992320 00010000:00010000:1.0:1788587125.196505:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 10 pid: 6706 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587125.196566:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:1.0:1788587125.196576:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2361:x1875469181992320:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587125.196591:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587125.196616:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 10 pid: 6706 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.196631:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 10 pid: 6706 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.196655:0:8474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587125.196659:0:8474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587125.196669:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.196680:0:8474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.196723:0:8474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 10 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587125.196737:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8474:1875469208203648:192.168.204.28@tcp:105: 00000100:00100000:1.0:1788587125.196813:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58be6c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788587125.197501:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab896a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ff expref: 10 pid: 6706 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.197520:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208203520:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587125.197559:0:6708:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 9 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.197570:0:6708:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051600, rc 0) 00000100:00100000:0.0:1788587125.197623:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:11532:x1875469181992192:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 7465us (7648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.197631:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:1.0:1788587125.210648:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8474:1875469208203648:192.168.204.28@tcp:105: 00010000:00010000:1.0:1788587125.210706:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587125.210783:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181992320:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 14207us (14446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587125.210794:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:0.0:1788587125.215106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587125.215185:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181992448 00000100:00100000:2.0:1788587125.215195:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181992448 00002000:00100000:2.0:1788587125.215245:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8bacc1ab3b80 x1875469181992448/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:441/0 lens 504/0 e 0 to 0 dl 1788587136 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587125.215256:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacc1ab3b80 with x1875469181992448 ext(0->8) 00002000:00010000:2.0:1788587125.215261:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacc1ab3b80 00000100:00100000:2.0:1788587125.215296:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1788587125.215306:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181992448:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587125.215744:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc1ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2361:x1875469181992448:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 437us (646us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788587125.215752:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00002000:00100000:2.0:1788587125.215759:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8bacc1ab3b80 x1875469181992448/t4294967314(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:441/0 lens 504/448 e 0 to 0 dl 1788587136 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587125.215768:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacc1ab3b80 with x1875469181992448 ext(0->8) 00002000:00010000:2.0:1788587125.215777:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacc1ab3b80 00000100:00100000:3.0:1788587125.227279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.227378:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181992576 00000100:00100000:0.0:1788587125.227388:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181992576 00000100:00100000:0.0:1788587125.227448:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 183 00000100:00100000:0.0:1788587125.227459:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11532:x1875469181992576:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788587125.252602:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208203776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587125.252759:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587125.269816:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208203776 00000100:00100000:0.0:1788587125.269833:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208203776 00000100:00100000:0.0:1788587125.269948:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587125.269959:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875469208203776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587125.270008:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587125.270092:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875469208203776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (17334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.270100:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788587125.270154:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208203776:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788587125.270374:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788587125.327494:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1788587125.327509:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1788587125.327547:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000020:00080000:3.0:1788587125.327561:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788587125.327577:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788587125.327586:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788587125.327892:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208203904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788587125.327978:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587125.329859:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208203904 00000100:00100000:1.0:1788587125.329875:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208203904 00000100:00100000:1.0:1788587125.329951:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587125.329962:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208203904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788587125.330147:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788587125.330151:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587124 00002000:00010000:1.0:1788587125.330153:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788587125.330155:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788587124 -> 1788587124 00002000:00010000:1.0:1788587125.330157:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788587125.330228:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208203904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (2249us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788587125.330236:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1788587125.330294:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bacae64f100/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788587125.330300:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208203904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788587125.332035:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181992576:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 104567us (104757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.332048:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 183 00000100:00100000:3.0:1788587125.345651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.345691:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181992704 00000100:00100000:3.0:1788587125.346506:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181992704 00000100:00100000:3.0:1788587125.346587:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:3.0:1788587125.346598:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2362:x1875469181992704:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788587125.449751:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788587125.477490:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1788587125.477509:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1788587125.482722:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181992704:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 136112us (137065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.482739:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:3.0:1788587125.489441:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.489550:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181992960 00000100:00100000:0.0:1788587125.489561:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181992960 00000100:00100000:0.0:1788587125.489627:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 184 00000100:00100000:0.0:1788587125.489638:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181992960:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587125.489700:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587125.489728:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5c00/0xc1a730b05ab8969d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f8 expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.489748:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:0.0:1788587125.489754:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587125.489783:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.489816:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.489825:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587125.490234:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b00e726 reply state 000000002fbcc84f transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.490244:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587125.490348:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11532:x1875469181992960:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 711us (915us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788587125.490356:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 184 00010000:00010000:0.0:1788587125.495513:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.495531:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.495539:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.495544:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.495549:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.495556:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.495575:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:0.0:1788587125.495592:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587125.495597:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.495610:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.496455:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587125.496548:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181993088 00000100:00100000:1.0:1788587125.496561:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181993088 00000100:00100000:1.0:1788587125.496616:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:1.0:1788587125.496625:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181993088:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788587125.496944:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788587125.496949:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788587124 -> 1788587123 00002000:00010000:1.0:1788587125.496952:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788587121 00002000:00010000:1.0:1788587125.496965:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788587124 -> 1788587123 00002000:00010000:1.0:1788587125.496967:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788587125.497026:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181993088:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 401us (576us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788587125.497035:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:3.0:1788587125.502063:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.502160:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181993344 00000100:00100000:0.0:1788587125.502169:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181993344 00000100:00100000:0.0:1788587125.502227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 185 00000100:00100000:0.0:1788587125.502237:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11532:x1875469181993344:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788587125.502314:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.502331:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.502340:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.502377:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.502391:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 18 pid: 5850 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.502405:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208204032:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587125.502503:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587125.505449:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208204032:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587125.505483:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.506905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.507134:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181993472 00000100:00100000:0.0:1788587125.507154:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181993472 00010000:00010000:0.0:1788587125.507193:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 19 pid: 5850 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.507230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:0.0:1788587125.507241:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:2361:x1875469181993472:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587125.507258:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587125.507266:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 19 pid: 5850 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.507279:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 19 pid: 5850 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.507304:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050400/0xc1a730b05ab89681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29ea expref: 19 pid: 5850 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.507324:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:0.0:1788587125.507329:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.507339:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.507346:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.508746:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587125.508822:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2361:x1875469181993472:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 1579us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.508866:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00010000:00010000:1.0:1788587125.514003:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.514021:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.514232:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.514241:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.514250:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.514263:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.514268:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.514276:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.514298:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:0.0:1788587125.514301:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788587125.514306:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.514312:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.514425:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:11532:x1875469181993344:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 12184us (12365us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788587125.514436:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 185 00000100:00100000:3.0:1788587125.517835:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587125.517987:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181993600 00000100:00100000:1.0:1788587125.517998:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181993600 00000100:00100000:1.0:1788587125.518057:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:1.0:1788587125.518066:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469181993600:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788587125.518114:0:6708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.518135:0:6708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.518144:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587125.518148:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587125.518153:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.518192:0:6708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 8 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.518219:0:6708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 8 pid: 6708 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587125.518236:0:6708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208204160:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587125.518330:0:6708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58be3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587125.521744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587125.521921:0:6708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6708:1875469208204160:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587125.521954:0:6708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.522076:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181993728 00000100:00100000:0.0:1788587125.522084:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181993728 00010000:00010000:0.0:1788587125.522133:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 9 pid: 6708 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.522174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:0.0:1788587125.522183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2361:x1875469181993728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587125.522198:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587125.522220:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 9 pid: 6708 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.522233:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 9 pid: 6708 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.522257:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab896ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a06 expref: 9 pid: 6708 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.522274:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587125.522278:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587125.522284:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.522294:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.522325:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587125.522383:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181993728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 201us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587125.522390:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 72 00010000:00010000:2.0:1788587125.522457:0:6708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522466:0:6708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522493:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522501:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522509:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522515:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587125.522520:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522529:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522542:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587125.522562:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab896c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587125.522608:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181993600:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 4542us (4798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587125.522615:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:2.0:1788587125.526605:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.526691:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181993984 00000100:00100000:0.0:1788587125.526703:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181993984 00000100:00100000:0.0:1788587125.526771:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 186 00000100:00100000:0.0:1788587125.526781:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+17:11532:x1875469181993984:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788587125.527100:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.527119:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.527131:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.527539:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.527553:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.527562:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.527601:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 18 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.527617:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 18 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.527631:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208204288:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587125.528454:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587125.546080:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.546272:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208204288:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587125.546298:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.546571:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181994112 00000100:00100000:3.0:1788587125.546579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181994112 00010000:00010000:3.0:1788587125.546620:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 19 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.546665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:3.0:1788587125.546686:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:2362:x1875469181994112:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587125.546702:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587125.546709:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 19 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.546722:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 19 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.546745:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8968f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29f1 expref: 19 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.546761:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:3.0:1788587125.546767:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.546777:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.546796:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.546883:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587125.546962:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2362:x1875469181994112:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 288us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.546969:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00010000:00010000:1.0:1788587125.548991:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587125.549008:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587125.549210:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788587125.549374:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788587125.549417:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788587125.549505:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208204416:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788587125.549571:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587125.549615:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb58be000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587125.550188:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208204416 00000100:00100000:3.0:1788587125.550197:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208204416 00000100:00100000:3.0:1788587125.550246:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587125.550258:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875469208204416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587125.550356:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875469208204416:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.550363:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587125.550453:0:5852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788587125.550459:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bacae64f100, transno 4294967315 00000100:00100000:0.0:1788587125.550481:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208204416:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788587125.551034:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788587125.551102:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208204544:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788587125.551142:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587125.551166:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788587125.551479:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208204544 00000100:00100000:3.0:1788587125.551485:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208204544 00000100:00100000:3.0:1788587125.551517:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587125.551525:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875469208204544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788587125.551712:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875469208204544:12345-0@lo:1000:mdt00_002.0 Request processed in 186us (568us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788587125.551719:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587125.552246:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbc89a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5852:1875469208204544:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788587125.552286:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552297:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552304:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552309:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.552313:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552407:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552422:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bcb00) 00010000:00010000:0.0:1788587125.552433:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587125.552439:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552446:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab896ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552476:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552482:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552487:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552492:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.552495:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552501:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552509:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439200) 00010000:00010000:0.0:1788587125.552512:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788587125.552514:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552519:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab8960a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552539:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552564:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 21 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552574:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552605:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 21 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.552621:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 21 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587125.552634:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacaf1bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208204672:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587125.557050:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb596f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587125.560532:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587125.560929:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacaf1bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208204672:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587125.560961:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.561196:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181994240 00000100:00100000:3.0:1788587125.561204:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181994240 00010000:00010000:3.0:1788587125.561242:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 22 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.561285:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:3.0:1788587125.561310:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:2362:x1875469181994240:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587125.561326:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587125.561334:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 22 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.561346:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 22 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.561371:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab89626 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c29d5 expref: 22 pid: 7662 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.561388:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439200) 00010000:00010000:3.0:1788587125.561392:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.561402:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.561411:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.561442:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587125.561501:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:2362:x1875469181994240:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 193us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587125.561508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 74 00010000:00010000:0.0:1788587125.562478:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562489:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562501:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562508:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562525:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562530:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.562534:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562541:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562554:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439200) 00010000:00010000:0.0:1788587125.562558:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587125.562561:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562566:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab896d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562577:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562583:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562587:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562593:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587125.562595:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562610:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562619:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8bac90439200) 00010000:00010000:0.0:1788587125.562621:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587125.562624:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.562629:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab896c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587125.565048:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587125.565057:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587125.565573:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788587125.565583:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587125.566738:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11532:x1875469181993984:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 36129us (36315us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788587125.566752:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 186 00000020:00080000:0.0:1788587125.566760:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788587125.580218:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587125.580311:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181994496 00000100:00100000:3.0:1788587125.580322:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181994496 00000100:00100000:3.0:1788587125.580387:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:3.0:1788587125.580399:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84661050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11532:x1875469181994496:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788587125.584074:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788587125.584186:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788587125.584247:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.584264:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.584278:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.584287:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.584294:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.584299:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587125.584319:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587125.584350:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587125.584357:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.584363:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587125.584367:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.584374:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.584386:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8bac987bc800) 00010000:00010000:0.0:1788587125.584389:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587125.584394:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587125.584412:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051800/0xc1a730b05ab896dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587125.584433:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84661050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:11532:x1875469181994496:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 4033us (4232us total) trans 4294967470 rc 0/0 00010000:00010000:0.0:1788587125.584433:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587125.584434:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587125.584436:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587125.584443:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000020:00080000:3.0:1788587125.584449:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788587126.480048:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587126.798620:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587126.798668:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587126.798693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587126.798714:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587126.798749:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587126.798793:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181994880 00000100:00100000:1.0:1788587126.798805:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181994880 00000100:00100000:1.0:1788587126.798876:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181995008 00000100:00100000:1.0:1788587126.798880:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181995008 00000100:00100000:1.0:1788587126.798933:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1788587126.798943:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2359:x1875469181994880:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587126.799016:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2359:x1875469181994880:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 73us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587126.799023:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1788587126.799042:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:1.0:1788587126.799049:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469181995008:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587126.799072:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469181995008:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587126.799078:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:1.0:1788587126.799095:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181995136 00000100:00100000:1.0:1788587126.799098:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181995136 00000100:00100000:1.0:1788587126.799123:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181994752 00000100:00100000:1.0:1788587126.799126:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181994752 00000100:00100000:1.0:1788587126.799146:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:1.0:1788587126.799152:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181995136:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587126.799179:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469181995136:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587126.799185:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 171 00000100:00100000:1.0:1788587126.799197:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00100000:1.0:1788587126.799203:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:2359:x1875469181994752:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587126.799228:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:2359:x1875469181994752:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587126.799241:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 172 00000100:00080000:1.0:1788587126.799259:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587126.799263:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587126.799976:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181994624 00000100:00100000:3.0:1788587126.799983:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181994624 00000100:00100000:3.0:1788587126.800027:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 303 00000100:00100000:3.0:1788587126.800034:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181994624:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587126.800075:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469181994624:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 41us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587126.800082:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 303 00000040:00080000:0.0:1788587127.211407:0:12593:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587127.211417:0:12593:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587127.211455:0:12593:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788587127.211460:0:12593:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788587127.379315:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:1.0:1788587127.398442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587127.398562:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181995392 00000100:00100000:2.0:1788587127.398574:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181995392 00000100:00100000:2.0:1788587127.398651:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 187 00000100:00100000:2.0:1788587127.398663:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:11551:x1875469181995392:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587127.398687:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587127.398708:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab896e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a0d expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.398814:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab896ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.398829:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab896ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.398867:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab896ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587127.398908:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788587127.399048:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab896e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a0d expref: 25 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.399068:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab896ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a0d expref: 24 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.399076:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587127.399079:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587127.399083:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5e00, rc 0) 00000100:00100000:2.0:1788587127.399143:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11551:x1875469181995392:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 483us (712us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788587127.399150:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 187 00000100:00100000:2.0:1788587127.404520:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587127.406359:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181995520 00000100:00100000:1.0:1788587127.406372:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181995520 00000100:00100000:1.0:1788587127.406439:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 188 00000100:00100000:1.0:1788587127.406450:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11551:x1875469181995520:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:1.0:1788587127.406533:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406552:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406565:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406580:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406587:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406594:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406900:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406909:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406937:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587127.406980:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.406993:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407000:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407007:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407013:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.407017:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407025:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407037:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587127.407040:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.407046:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407053:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab896f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407064:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407077:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407084:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407089:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.407092:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407099:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407107:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca1025f00) 00010000:00010000:1.0:1788587127.407110:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.407112:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407119:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab896ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407133:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407139:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407145:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407149:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.407159:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407165:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407174:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca1025b00) 00010000:00010000:1.0:1788587127.407177:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.407179:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.407186:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5e00/0xc1a730b05ab89706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587127.407275:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11551:x1875469181995520:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 826us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587127.407283:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 188 00000100:00100000:3.0:1788587127.484627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587127.484818:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181995776 00000100:00100000:2.0:1788587127.484832:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181995776 00000100:00100000:2.0:1788587127.484938:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 189 00000100:00100000:2.0:1788587127.484949:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11554:x1875469181995776:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587127.484970:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587127.484992:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8970d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a14 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485079:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485096:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485126:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485143:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485151:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485158:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485738:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485748:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485756:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587127.485768:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788587127.485922:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485931:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485938:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485944:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587127.485955:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485963:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485975:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587127.485979:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587127.485984:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.485990:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab89714 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486004:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486010:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486016:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486021:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587127.486024:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486029:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486036:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca0968d00) 00010000:00010000:2.0:1788587127.486039:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587127.486048:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486053:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8971b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486099:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8970d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 27 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486114:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 26 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.486121:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:2.0:1788587127.486123:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587127.486126:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4200, rc 0) 00000100:00100000:2.0:1788587127.486194:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:11554:x1875469181995776:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1247us (1583us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788587127.493793:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 189 00000100:00100000:2.0:1788587127.493937:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587127.493979:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181995904 00000100:00100000:2.0:1788587127.493990:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181995904 00000100:00100000:2.0:1788587127.494039:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 190 00000100:00100000:2.0:1788587127.494050:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:11554:x1875469181995904:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:2.0:1788587127.494126:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494148:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494160:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494212:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494220:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494227:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494232:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587127.494237:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494245:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494257:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:2.0:1788587127.494260:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587127.494265:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.494271:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587127.494360:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:11554:x1875469181995904:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 311us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587127.494368:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 190 00010000:00010000:0.0:1788587127.501328:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587127.503528:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587127.503810:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181996160 00000100:00100000:3.0:1788587127.503820:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181996160 00000100:00100000:3.0:1788587127.504016:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:3.0:1788587127.504027:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:11554:x1875469181996160:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1788587127.506016:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:11554:x1875469181996160:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 1983us (2487us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788587127.506030:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:2.0:1788587127.598771:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587127.599269:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181996416 00000100:00100000:3.0:1788587127.599283:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181996416 00000100:00100000:3.0:1788587127.599352:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 191 00000100:00100000:3.0:1788587127.599362:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:11080:x1875469181996416:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587127.599390:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587127.599420:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89737 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a1b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.599538:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.599554:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 28 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.599576:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.599613:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 28 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.599627:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 28 pid: 7662 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.599641:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208204800:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587127.599735:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ec3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587127.606322:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587127.606426:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181996544 00000100:00100000:0.0:1788587127.606438:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181996544 00010000:00010000:0.0:1788587127.606484:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 29 pid: 7662 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587127.606522:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:0.0:1788587127.606533:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:2362:x1875469181996544:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587127.606550:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587127.606558:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 29 pid: 7662 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.606572:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 29 pid: 7662 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.606616:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:0.0:1788587127.606621:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.606631:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.606649:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.606672:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587127.606737:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:2362:x1875469181996544:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 205us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587127.606744:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00010000:00010000:1.0:1788587127.607073:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab89722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a14 expref: 28 pid: 7662 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587127.607091:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208204800:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587127.607113:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.607814:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.607825:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587127.607882:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788587127.608047:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051400/0xc1a730b05ab89737 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.608069:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587127.608077:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:0.0:1788587127.608080:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587127.608095:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051200, rc 0) 00000100:00100000:0.0:1788587127.608138:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:11080:x1875469181996416:12345-192.168.204.28@tcp:101:bash.0 Request processed in 8778us (9377us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788587127.608148:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 191 00000100:00100000:3.0:1788587127.616419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587127.616620:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181996800 00000100:00100000:2.0:1788587127.616658:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181996800 00000100:00100000:2.0:1788587127.616728:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 192 00000100:00100000:2.0:1788587127.616740:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:11080:x1875469181996800:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:2.0:1788587127.617296:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.617316:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.617327:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587127.617380:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1788587127.617406:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000574acf8e reply state 00000000b696a656 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587127.617416:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788587127.617462:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788587127.617631:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:11080:x1875469181996800:12345-192.168.204.28@tcp:36:bash.0 Request processed in 892us (1219us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788587127.617639:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 192 00000020:00080000:2.0:1788587127.617644:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788587127.627921:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.627939:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.627947:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.627953:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587127.627958:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.627966:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.627984:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:3.0:1788587127.628002:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587127.628007:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.628014:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8974c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587127.628351:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587127.628430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181996928 00000100:00100000:1.0:1788587127.628441:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181996928 00000100:00100000:1.0:1788587127.628488:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 193 00000100:00100000:1.0:1788587127.628498:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:11080:x1875469181996928:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587127.628523:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587127.628547:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab89753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a22 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.628606:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab89753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a22 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.628619:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab89753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a22 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.628636:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:1.0:1788587127.628639:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587127.628649:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4800, rc 0) 00000100:00100000:1.0:1788587127.628711:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:11080:x1875469181996928:12345-192.168.204.28@tcp:101:bash.0 Request processed in 214us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587127.628719:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 193 00000100:00100000:2.0:1788587127.637277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587127.637371:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181997056 00000100:00100000:1.0:1788587127.637382:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181997056 00000100:00100000:1.0:1788587127.637459:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:1.0:1788587127.637470:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:11080:x1875469181997056:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587127.637488:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587127.637510:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a29 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587127.637550:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bac73, atime: 0x6a9bac71, ctime: 0x6a9bac73, blocks: 0xb 00010000:00010000:1.0:1788587127.637572:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=449s v=(0 0) 00010000:00010000:1.0:1788587127.637577:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587127.637585:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.637615:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.637629:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5200, rc 0) 00000100:00100000:1.0:1788587127.637707:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:11080:x1875469181997056:12345-192.168.204.28@tcp:101:bash.0 Request processed in 238us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587127.637715:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00080000:2.0:1788587127.638378:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587127.640717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587127.640958:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181997184 00000100:00100000:3.0:1788587127.640968:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181997184 00002000:00010000:3.0:1788587127.641009:0:6713:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788587127.641014:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacae561c00 with x1875469181997184 ext(0->18446744073709551615) 00002000:00010000:3.0:1788587127.641025:0:6713:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacae561c00. 00000100:00100000:3.0:1788587127.641059:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:3.0:1788587127.641070:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469181997184:12345-192.168.204.28@tcp:10:bash.0 00002000:00010000:3.0:1788587127.641343:0:6713:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788587127.641347:0:6713:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788587123 -> 1788587127 00002000:00010000:3.0:1788587127.641350:0:6713:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788587121 -> 1788587121 00002000:00010000:3.0:1788587127.641352:0:6713:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788587123 -> 1788587127 00002000:00010000:3.0:1788587127.641354:0:6713:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788587127.641480:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2361:x1875469181997184:12345-192.168.204.28@tcp:10:bash.0 Request processed in 411us (772us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788587127.641488:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00002000:00010000:3.0:1788587127.641492:0:6713:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788587127.641495:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacae561c00 with x1875469181997184 ext(0->18446744073709551615) 00002000:00010000:3.0:1788587127.641500:0:6713:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacae561c00. 00000100:00100000:0.0:1788587127.764143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587127.764440:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181997312 00000100:00100000:1.0:1788587127.764451:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181997312 00000100:00100000:1.0:1788587127.764514:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 194 00000100:00100000:1.0:1788587127.764524:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:11568:x1875469181997312:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:1.0:1788587127.764604:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.764623:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.764647:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.764663:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.764670:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.764677:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765002:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765012:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765020:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587127.765064:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765076:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765082:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765089:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765095:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.765099:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765107:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765118:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587127.765121:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.765127:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765140:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765153:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765159:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765164:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765168:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.765170:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765176:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765183:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca1025700) 00010000:00010000:1.0:1788587127.765185:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.765188:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765193:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab89768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765207:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765213:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765224:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765229:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.765232:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765239:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765246:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:1.0:1788587127.765248:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.765251:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.765256:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab8976f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587127.765336:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:11568:x1875469181997312:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 812us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587127.765344:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 194 00000100:00100000:0.0:1788587127.831209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587127.831634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181997568 00000100:00100000:1.0:1788587127.831645:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181997568 00000100:00100000:1.0:1788587127.831712:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:1.0:1788587127.831722:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+32:11571:x1875469181997568:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587127.831742:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587127.831765:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a30 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.831906:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.831932:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.831946:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.831963:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.831969:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.831976:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832251:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab8978b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832261:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab8978b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832269:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab8978b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587127.832280:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788587127.832373:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832380:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832393:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832399:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.832404:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832412:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832425:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587127.832428:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.832433:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832439:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab8977d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832451:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832456:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832462:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832466:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587127.832469:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832484:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832491:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca1025700) 00010000:00010000:1.0:1788587127.832493:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587127.832496:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832501:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab89784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832544:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a30 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832558:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab8978b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a30 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.832566:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:1.0:1788587127.832568:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788587127.832570:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5400, rc 0) 00000100:00100000:1.0:1788587127.832642:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11571:x1875469181997568:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 920us (1442us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788587127.832650:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 195 00000100:00100000:3.0:1788587127.836197:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587127.836758:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181997696 00000100:00100000:1.0:1788587127.836768:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181997696 00000100:00100000:1.0:1788587127.836836:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 196 00000100:00100000:1.0:1788587127.836883:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11571:x1875469181997696:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:1.0:1788587127.836984:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.837003:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.837013:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.837051:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587127.837065:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 34 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587127.837079:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208204928:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587127.837179:0:7662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587127.839658:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587127.839950:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181997952 00000100:00100000:0.0:1788587127.839959:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181997952 00000100:00100000:0.0:1788587127.840013:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:0.0:1788587127.840023:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:5602:x1875469181997952:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788587127.840371:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:5602:x1875469181997952:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 348us (720us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788587127.840379:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1788587127.841017:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208204928:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587127.841045:0:7662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587127.847435:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587127.847555:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181998080 00000100:00100000:3.0:1788587127.847564:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181998080 00010000:00010000:3.0:1788587127.847615:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 36 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.847665:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:3.0:1788587127.847676:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88343050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:2362:x1875469181998080:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587127.847691:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587127.847698:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 36 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.847712:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 36 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.847744:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8973e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a1b expref: 36 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.847761:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:3.0:1788587127.847767:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.847776:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.847784:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587127.847820:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587127.847896:0:7662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.847916:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587127.847946:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88343050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:2362:x1875469181998080:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 273us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587127.847953:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00010000:00010000:2.0:1788587127.847956:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.847963:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.847969:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.847974:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587127.847979:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.847986:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.847994:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:2.0:1788587127.847997:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587127.848000:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587127.848006:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587127.848049:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11571:x1875469181997696:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 11178us (11864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587127.848057:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 196 00000100:00100000:3.0:1788587127.850334:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587127.854926:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181998336 00000100:00100000:2.0:1788587127.854943:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181998336 00000100:00100000:2.0:1788587127.855019:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:2.0:1788587127.855045:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+34:11571:x1875469181998336:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587127.855535:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:11571:x1875469181998336:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 491us (5210us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788587127.855544:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:3.0:1788587128.011670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.011902:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181998592 00000100:00100000:1.0:1788587128.011923:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181998592 00000100:00100000:1.0:1788587128.012011:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00100000:1.0:1788587128.012023:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+35:11582:x1875469181998592:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:1.0:1788587128.012048:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587128.012071:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab897a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a37 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012164:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012180:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012192:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012208:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012216:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012223:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012495:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab897b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012504:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab897b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012512:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab897b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587128.012521:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788587128.012608:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012617:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012630:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012636:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587128.012641:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012650:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012662:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587128.012666:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587128.012670:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012677:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab897a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012691:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012697:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012703:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012708:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587128.012711:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012727:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012735:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca1025700) 00010000:00010000:1.0:1788587128.012737:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587128.012740:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012746:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab897ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012789:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab897a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a37 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012817:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab897b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a37 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.012824:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:1.0:1788587128.012827:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587128.012829:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5800, rc 0) 00000100:00100000:1.0:1788587128.013353:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:11582:x1875469181998592:12345-192.168.204.28@tcp:101:cat.0 Request processed in 1330us (1689us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788587128.013362:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 197 00000100:00080000:2.0:1788587128.014095:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587128.022253:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.022334:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181998848 00000100:00100000:1.0:1788587128.022344:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181998848 00000100:00100000:1.0:1788587128.022403:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:1.0:1788587128.022412:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:11582:x1875469181998848:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:1.0:1788587128.022668:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:11582:x1875469181998848:12345-192.168.204.28@tcp:35:cat.0 Request processed in 256us (425us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788587128.022676:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:0.0:1788587128.050570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587128.050686:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181999104 00000100:00100000:2.0:1788587128.050698:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181999104 00000100:00100000:2.0:1788587128.050758:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 198 00000100:00100000:2.0:1788587128.050770:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:11583:x1875469181999104:12345-192.168.204.28@tcp:36:rm.0 00010000:00010000:2.0:1788587128.050828:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788587128.050900:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab897b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a37 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.050935:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab8978b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a30 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.050948:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab89753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a22 expref: 36 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.050957:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968300) 00010000:00010000:2.0:1788587128.050968:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587128.050990:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051005:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051015:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051038:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051046:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051053:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051292:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051302:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.051309:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587128.051930:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788587128.051942:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 450256098019ns, next at 451256095177ns, rc = 0 00010000:00010000:2.0:1788587128.051998:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052009:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052017:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052024:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052040:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052047:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052071:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587128.052093:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052097:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052103:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052108:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587128.052113:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052120:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052130:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:2.0:1788587128.052132:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788587128.052135:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052141:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab897d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052156:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052169:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052175:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052180:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587128.052183:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052189:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052198:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587128.052200:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587128.052203:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.052209:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab897c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587128.052218:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c22e455 reply state 0000000011b209a8 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587128.052227:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587128.052312:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+37:11583:x1875469181999104:12345-192.168.204.28@tcp:36:rm.0 Request processed in 1542us (1749us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788587128.052320:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 198 00010000:00010000:0.0:1788587128.052887:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587128.052897:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.052913:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587128.052917:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.052925:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.052934:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:0.0:1788587128.052937:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788587128.052951:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.052957:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab897d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.052973:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587128.052975:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587128.052976:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587128.059441:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.059463:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.059471:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.059478:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587128.059485:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.059493:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.059513:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca0968d00) 00010000:00010000:0.0:1788587128.059516:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587128.059521:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.059528:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab897ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.127814:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.127891:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181999360 00000100:00100000:3.0:1788587128.127902:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181999360 00000100:00100000:3.0:1788587128.127980:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00100000:3.0:1788587128.128032:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+36:11589:x1875469181999360:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587128.128056:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587128.128077:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab897df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a3e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.128198:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.128215:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.128227:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.128243:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.128250:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.128256:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788587128.128830:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788587128.129055:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129076:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129085:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129125:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129133:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129139:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129144:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587128.129148:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129155:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129169:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:3.0:1788587128.129172:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587128.129177:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129183:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab897e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587128.129198:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093412e0e reply state 0000000005088860 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.129215:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788587128.129249:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab897df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129265:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.129272:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587128.129274:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587128.129277:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050200, rc 0) 00000100:00100000:3.0:1788587128.129357:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:11589:x1875469181999360:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1367us (1551us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788587128.129366:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 199 00000100:00100000:3.0:1788587128.133380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1788587128.136029:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.136049:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.136057:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.136063:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587128.136069:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.136076:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.136094:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac987bc400) 00010000:00010000:0.0:1788587128.136097:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587128.136101:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.136107:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab897ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587128.142522:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181999488 00000100:00100000:2.0:1788587128.142538:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181999488 00000100:00100000:2.0:1788587128.142694:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:2.0:1788587128.142705:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2361:x1875469181999488:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587128.142723:0:10779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587128.142745:0:10779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a45 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587128.142774:0:10779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587128.142794:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1788587128.142799:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00080000:1.0:1788587128.142801:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788587128.142810:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 6 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.142831:0:10779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 6 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.142861:0:10779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5200, rc 0) 00000100:00100000:2.0:1788587128.142941:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2361:x1875469181999488:12345-192.168.204.28@tcp:101:bash.0 Request processed in 238us (9572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.142948:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:0.0:1788587128.150664:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.150763:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181999616 00000100:00100000:1.0:1788587128.150782:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181999616 00000100:00100000:1.0:1788587128.150881:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:1.0:1788587128.150891:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:11589:x1875469181999616:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587128.150910:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587128.150928:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a4c expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.150960:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.150969:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587128.150973:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587128.150978:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.151014:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 7 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.151029:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 7 pid: 10779 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.151064:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6706:1875469208205056:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587128.151164:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587128.155607:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6706:1875469208205056:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587128.155656:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.155680:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4000, rc 0) 00000100:00100000:1.0:1788587128.155747:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:11589:x1875469181999616:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4857us (5092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.155755:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:2.0:1788587128.159168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.159270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469181999744 00000100:00100000:0.0:1788587128.159280:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469181999744 00010000:00010000:0.0:1788587128.159324:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 7 pid: 10779 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.159390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:0.0:1788587128.159400:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469181999744:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587128.159417:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587128.159444:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 7 pid: 10779 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.159457:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 7 pid: 10779 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.159482:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a330045a/0xc1a730b05ab89802 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a45 expref: 7 pid: 10779 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.159500:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587128.159504:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587128.159513:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.159523:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.159734:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.159749:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875469208205184:192.168.204.28@tcp:105: 00000100:00100000:0.0:1788587128.160173:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587128.168579:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9ac700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875469208205184:192.168.204.28@tcp:105: 00010000:00010000:1.0:1788587128.168613:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587128.168692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469181999744:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 9293us (9534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.168703:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:3.0:1788587128.172051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587128.172362:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182000000 00000100:00100000:2.0:1788587128.172372:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182000000 00000100:00100000:2.0:1788587128.172427:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:2.0:1788587128.172436:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+38:11589:x1875469182000000:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1788587128.173126:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:11589:x1875469182000000:12345-192.168.204.28@tcp:35:bash.0 Request processed in 687us (1080us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788587128.173152:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:2.0:1788587128.432922:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.433012:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182000128 00000100:00100000:0.0:1788587128.433023:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182000128 00000100:00100000:0.0:1788587128.433080:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 200 00000100:00100000:0.0:1788587128.433089:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+39:11605:x1875469182000128:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587128.433112:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587128.433136:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab89810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a53 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.433213:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.433230:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.433243:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587128.433285:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788587128.433288:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587128.433306:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.433331:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab89810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a53 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.433347:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a53 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.433356:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:0.0:1788587128.433366:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587128.433370:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99a00, rc 0) 00000100:00100000:0.0:1788587128.433426:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:11605:x1875469182000128:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 337us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.433432:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 200 00000100:00100000:0.0:1788587128.444000:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.444096:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182000384 00000100:00100000:3.0:1788587128.444106:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182000384 00000100:00100000:3.0:1788587128.444168:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:3.0:1788587128.444178:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+40:11605:x1875469182000384:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587128.444200:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587128.444404:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8981e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a5a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.444515:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.444530:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.444558:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587128.444570:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788587128.444699:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab8981e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a5a expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.444720:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a5a expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.444729:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587128.444731:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587128.444735:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:3.0:1788587128.444944:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+42:11605:x1875469182000384:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 766us (953us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788587128.444952:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 201 00000100:00100000:3.0:1788587128.449962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.450034:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182000640 00000100:00100000:0.0:1788587128.450044:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182000640 00000100:00100000:0.0:1788587128.450103:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 202 00000100:00100000:0.0:1788587128.450113:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+42:11605:x1875469182000640:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587128.450138:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587128.450161:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab89833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a61 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.450282:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8983a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.450298:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8983a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.450309:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8983a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587128.450321:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788587128.450445:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab89833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a61 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.450463:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8983a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a61 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.450483:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:0.0:1788587128.450485:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788587128.450488:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587128.450561:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:11605:x1875469182000640:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 449us (607us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1788587128.450568:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 202 00000100:00100000:2.0:1788587128.455612:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.458211:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182000768 00000100:00100000:3.0:1788587128.458227:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182000768 00000100:00100000:0.0:1788587128.458245:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.458307:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:3.0:1788587128.458319:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+44:2360:x1875469182000768:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.458336:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788587128.458355:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182000896 00000100:00100000:1.0:1788587128.458359:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182000896 00010000:00010000:3.0:1788587128.458365:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a5a expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.458385:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8bac987bc900) 00000100:00100000:1.0:1788587128.458398:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00010000:00010000:3.0:1788587128.458404:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587128.458405:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+6:2362:x1875469182000896:12345-192.168.204.28@tcp:1:lfs.0 00010000:00010000:1.0:1788587128.458441:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.458454:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:2360:x1875469182000768:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 139us (2853us total) trans 0 rc 0/0 00010000:00010000:1.0:1788587128.458458:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.458461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00010000:00010000:1.0:1788587128.458473:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587128.458477:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587128.458482:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.458517:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.458531:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 6 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.458545:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875469208205312:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587128.458607:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587128.463555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.463642:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182001024 00000100:00100000:0.0:1788587128.463653:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182001024 00002000:00100000:0.0:1788587128.463710:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8bacae562680 x1875469182001024/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:444/0 lens 504/0 e 0 to 0 dl 1788587139 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788587128.463723:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacae562680 with x1875469182001024 ext(0->8) 00010000:00010000:0.0:1788587128.463734:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 7 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.463753:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 7 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587128.463762:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacae562680 00000100:00100000:0.0:1788587128.463807:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:0.0:1788587128.463818:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469182001024:12345-192.168.204.28@tcp:4:lfs.0 00000100:00100000:0.0:1788587128.464566:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2361:x1875469182001024:12345-192.168.204.28@tcp:4:lfs.0 Request processed in 748us (1020us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788587128.464576:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00002000:00100000:0.0:1788587128.464592:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8bacae562680 x1875469182001024/t4294967308(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:444/0 lens 504/448 e 0 to 0 dl 1788587139 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788587128.464600:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacae562680 with x1875469182001024 ext(0->8) 00010000:00010000:0.0:1788587128.464608:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 9 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.464632:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 9 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587128.464640:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bacae562680 00000100:00100000:1.0:1788587128.465015:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6707:1875469208205312:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587128.465044:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587128.467981:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.468245:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182001152 00000100:00100000:3.0:1788587128.468257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182001152 00010000:00010000:3.0:1788587128.468300:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 9 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.468349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:3.0:1788587128.468359:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2362:x1875469182001152:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.468376:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788587128.468397:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788587128.468400:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788587127 00002000:00010000:3.0:1788587128.468403:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788587128 00002000:00010000:3.0:1788587128.468405:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788587127 00010000:00010000:3.0:1788587128.468411:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 9 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.468426:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 9 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.468450:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537c304f/0xc1a730b05ab89809 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a4c expref: 9 pid: 6706 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.468467:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587128.468472:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788587128.468493:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.468504:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.468545:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.468608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469182001152:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 250us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.468624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00010000:00010000:0.0:1788587128.469221:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469234:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469261:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469269:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469276:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469283:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587128.469296:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469306:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469319:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.469327:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9c409ed/0xc1a730b05ab89848 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.469384:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469182000896:12345-192.168.204.28@tcp:1:lfs.0 Request processed in 10978us (11143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.469393:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:2.0:1788587128.472224:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.472592:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182001408 00000100:00100000:1.0:1788587128.472602:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182001408 00000100:00100000:1.0:1788587128.472667:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:1.0:1788587128.472678:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84662450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+43:11605:x1875469182001408:12345-192.168.204.28@tcp:35:lfs.0 00000004:00010000:1.0:1788587128.472748:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8983a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a61 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587128.473343:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788587128.473392:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788587128.473707:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1788587128.473778:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.473797:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.473806:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.473893:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.474181:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 47 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.474202:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208205440:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587128.474362:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004480 going to sleep for 11 seconds 00000100:00100000:2.0:1788587128.481370:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.482178:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182001536 00000100:00100000:3.0:1788587128.482190:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182001536 00010000:00010000:3.0:1788587128.482235:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 48 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.482272:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:3.0:1788587128.482282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:2362:x1875469182001536:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.482301:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.482308:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 48 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.482323:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 48 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.482349:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:3.0:1788587128.482355:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.482382:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.482391:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.482411:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.482476:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+48:2362:x1875469182001536:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 194us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.482484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 79 00010000:00010000:1.0:1788587128.483755:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab897f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a3e expref: 47 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.484032:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875469208205440:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587128.484058:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.484088:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.484095:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587128.484233:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1788587128.484432:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788587128.484541:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208205568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587128.484604:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587128.484773:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004300 going to sleep for 11 seconds 00000100:00100000:3.0:1788587128.485304:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208205568 00000100:00100000:3.0:1788587128.485315:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208205568 00000100:00100000:3.0:1788587128.485391:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587128.485401:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208205568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587128.485491:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208205568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.485499:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788587128.485597:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587128.485633:0:5853:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788587128.485639:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bacbf98df80, transno 4294967307 00000100:00100000:1.0:1788587128.485693:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208205568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788587128.486204:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788587128.486277:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208205696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788587128.486316:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587128.486346:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004480 going to sleep for 11 seconds 00000100:00100000:3.0:1788587128.486576:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208205696 00000100:00100000:3.0:1788587128.486582:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208205696 00000100:00100000:3.0:1788587128.486627:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587128.486636:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875469208205696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788587128.486783:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875469208205696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 148us (466us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788587128.486791:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587128.486993:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875469208205696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788587128.487039:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788587128.487071:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.487081:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.487088:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.487103:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587128.487108:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.487116:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.487131:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:1.0:1788587128.487134:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788587128.487139:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.487146:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8984f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788587128.487312:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788587128.487407:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788587128.487418:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 450691574725ns, next at 451691572455ns, rc = 0 00000001:00080000:1.0:1788587128.487425:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788587128.487455:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8bac987bc900) 00010000:00010000:1.0:1788587128.487459:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788587128.487466:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8983a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a61 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.487563:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84662450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:11605:x1875469182001408:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 14886us (15348us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788587128.487571:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000020:00080000:1.0:1788587128.487574:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788587128.491981:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.492231:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182001664 00000100:00100000:1.0:1788587128.492241:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182001664 00000100:00100000:1.0:1788587128.492386:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 203 00000100:00100000:1.0:1788587128.492399:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+50:11605:x1875469182001664:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587128.492427:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587128.492454:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4400/0xc1a730b05ab89856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a68 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.492520:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4400/0xc1a730b05ab89856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a68 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.492535:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4400/0xc1a730b05ab89856 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a68 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.492553:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:1.0:1788587128.492556:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587128.492560:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4400, rc 0) 00000100:00100000:1.0:1788587128.492627:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:11605:x1875469182001664:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 223us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.492635:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 203 00000100:00100000:3.0:1788587128.495586:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587128.495951:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182001920 00000100:00100000:2.0:1788587128.495961:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182001920 00000100:00100000:2.0:1788587128.496022:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:2.0:1788587128.496033:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+51:11605:x1875469182001920:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:2.0:1788587128.496282:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11605:x1875469182001920:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 250us (705us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788587128.496290:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00010000:00010000:1.0:1788587128.515581:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587128.590651:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587128.590755:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182002048 00000100:00100000:2.0:1788587128.590768:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182002048 00000100:00100000:2.0:1788587128.590838:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 204 00000100:00100000:2.0:1788587128.590887:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11615:x1875469182002048:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:2.0:1788587128.590973:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.590991:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591003:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591036:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591044:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591050:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591139:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591148:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591154:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587128.591203:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591218:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591228:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591234:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591240:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587128.591244:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591258:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591273:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587128.591277:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587128.591282:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591289:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab8985d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591303:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591309:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591315:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591320:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587128.591322:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591327:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591334:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca0968200) 00010000:00010000:2.0:1788587128.591336:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587128.591339:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591354:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591370:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591376:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591382:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591387:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587128.591389:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591395:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591402:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587128.591405:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587128.591407:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.591413:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8986b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587128.591495:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11615:x1875469182002048:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 611us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.591503:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 204 00000040:00080000:0.0:1788587128.644417:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587128.644426:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587128.644458:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788587128.644464:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587128.652531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.652652:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182002304 00000100:00100000:0.0:1788587128.652661:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182002304 00000100:00100000:0.0:1788587128.652780:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 205 00000100:00100000:0.0:1788587128.652792:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+52:11618:x1875469182002304:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587128.652814:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587128.652837:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a6f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653357:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653372:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653383:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653396:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653402:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653409:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653527:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653535:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653542:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587128.653552:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788587128.653647:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653655:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653669:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653675:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587128.653679:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653687:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653698:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:0.0:1788587128.653701:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587128.653705:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653712:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89879 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653725:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653733:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653738:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.653744:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587128.653746:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.654369:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.654385:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac90439d00) 00010000:00010000:0.0:1788587128.654387:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587128.654390:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.654396:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab89880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.654451:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab89872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.654466:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.654473:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:0.0:1788587128.654476:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587128.654478:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99400, rc 0) 00000100:00100000:0.0:1788587128.654689:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:11618:x1875469182002304:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1897us (2168us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788587128.654698:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 205 00000100:00100000:2.0:1788587128.658596:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.658752:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182002432 00000100:00100000:0.0:1788587128.659032:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182002432 00000100:00100000:0.0:1788587128.659121:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 206 00000100:00100000:0.0:1788587128.659132:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:11618:x1875469182002432:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:0.0:1788587128.659216:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659234:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659245:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659272:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659280:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659287:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659292:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587128.659296:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659304:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659316:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:0.0:1788587128.659319:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587128.659324:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.659330:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab89895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.659416:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:11618:x1875469182002432:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 284us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.659423:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 206 00000100:00100000:2.0:1788587128.662140:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.662282:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182002688 00000100:00100000:3.0:1788587128.662310:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182002688 00000100:00100000:3.0:1788587128.662384:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:3.0:1788587128.662397:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+54:11618:x1875469182002688:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1788587128.663298:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:11618:x1875469182002688:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 900us (1166us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788587128.663308:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:3.0:1788587128.745697:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.745819:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182002944 00000100:00100000:1.0:1788587128.745829:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182002944 00000100:00100000:1.0:1788587128.745934:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 207 00000100:00100000:1.0:1788587128.745946:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:11628:x1875469182002944:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:1.0:1788587128.745970:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587128.745975:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788587128.746004:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab89817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a53 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.746037:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587128.746043:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587128.746057:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8989c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a76 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.746152:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.746166:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.746175:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.746207:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.746221:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 55 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.746236:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208205824:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587128.746336:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac860049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587128.753079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.753307:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208205824:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587128.753339:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.753455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182003072 00000100:00100000:3.0:1788587128.753463:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182003072 00010000:00010000:3.0:1788587128.753505:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 56 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.753545:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:3.0:1788587128.753555:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+56:2362:x1875469182003072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.753571:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.753579:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 56 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.753592:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 56 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.753627:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab89887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a6f expref: 56 pid: 5851 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.753643:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587128.753648:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.753676:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.753683:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.753713:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.753774:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:2362:x1875469182003072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 220us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.753792:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00010000:00010000:2.0:1788587128.754557:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.754567:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587128.754587:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788587128.754754:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5600/0xc1a730b05ab8989c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.754771:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.754789:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587128.754792:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587128.754795:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4600, rc 0) 00000100:00100000:2.0:1788587128.754884:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:11628:x1875469182002944:12345-192.168.204.28@tcp:101:bash.0 Request processed in 8941us (9199us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788587128.754892:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 207 00000100:00100000:2.0:1788587128.757976:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.758448:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182003328 00000100:00100000:1.0:1788587128.758472:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182003328 00000100:00100000:1.0:1788587128.758581:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 208 00000100:00100000:1.0:1788587128.758592:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+55:11628:x1875469182003328:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:1.0:1788587128.759530:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.759550:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.759561:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587128.759629:0:7662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1788587128.759662:0:7662:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbf44c5e reply state 00000000c98f5782 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.759672:0:7662:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587128.759835:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:11628:x1875469182003328:12345-192.168.204.28@tcp:36:bash.0 Request processed in 1241us (1867us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788587128.759872:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 208 00000020:00080000:1.0:1788587128.759878:0:7662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788587128.764333:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1788587128.764398:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.764411:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.764418:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.764424:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587128.764429:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.764452:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.764468:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:1.0:1788587128.764471:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587128.764476:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.764482:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4e00/0xc1a730b05ab898b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.764715:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182003456 00000100:00100000:0.0:1788587128.764726:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182003456 00000100:00100000:0.0:1788587128.764794:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:0.0:1788587128.764804:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:11628:x1875469182003456:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1788587128.764826:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587128.764871:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a7d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.764952:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.764967:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.764977:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.765011:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.765025:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 58 pid: 5850 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.765039:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208205952:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587128.765685:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587128.768419:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875469208205952:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587128.768449:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.772052:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.772472:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182003584 00000100:00100000:3.0:1788587128.772483:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182003584 00010000:00010000:3.0:1788587128.772525:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 59 pid: 5850 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587128.772607:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:3.0:1788587128.772628:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:2362:x1875469182003584:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.772643:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.772651:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 59 pid: 5850 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.772664:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 59 pid: 5850 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.772687:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4600/0xc1a730b05ab898a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a76 expref: 59 pid: 5850 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.772725:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587128.772731:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.772742:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.772750:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.773268:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.773331:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:2362:x1875469182003584:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 713us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.773340:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00010000:00010000:1.0:1788587128.773666:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.773675:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587128.773721:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587128.773725:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587128.773744:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.773790:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.773807:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.773815:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:1.0:1788587128.773827:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788587128.773830:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99600, rc 0) 00000100:00100000:1.0:1788587128.773898:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:11628:x1875469182003456:12345-192.168.204.28@tcp:101:bash.0 Request processed in 9095us (9574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.773918:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 209 00000100:00100000:1.0:1788587128.777594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587128.777751:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182003840 00000100:00100000:2.0:1788587128.777771:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182003840 00000100:00100000:2.0:1788587128.777891:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:2.0:1788587128.777903:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+57:11628:x1875469182003840:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:2.0:1788587128.778142:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:11628:x1875469182003840:12345-192.168.204.28@tcp:35:bash.0 Request processed in 242us (559us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788587128.778160:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:3.0:1788587128.850458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.850636:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182003968 00000100:00100000:0.0:1788587128.850648:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182003968 00000100:00100000:0.0:1788587128.850714:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 210 00000100:00100000:0.0:1788587128.850725:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+58:11634:x1875469182003968:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587128.850752:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587128.850787:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab898c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a84 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.850938:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.850954:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.850966:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587128.851003:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788587128.851007:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587128.851026:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.851052:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab898c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a84 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.851088:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a84 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.851097:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:0.0:1788587128.851100:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587128.851104:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98c00, rc 0) 00000100:00100000:0.0:1788587128.851162:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:11634:x1875469182003968:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 439us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587128.851169:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 210 00000100:00100000:1.0:1788587128.856802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587128.857127:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182004096 00000100:00100000:2.0:1788587128.857137:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182004096 00000100:00100000:2.0:1788587128.857201:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:2.0:1788587128.857212:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:11634:x1875469182004096:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587128.857234:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587128.857267:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab898d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a8b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857337:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857354:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857367:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857383:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857391:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857397:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857489:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab898e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857518:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab898e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857525:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab898e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587128.857561:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788587128.857565:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587128.857583:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab898e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857594:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab898e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857602:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857621:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857628:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857633:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587128.857637:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857645:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857660:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587128.857663:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587128.857674:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857681:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab898db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857695:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857701:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857706:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857712:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587128.857715:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857720:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857728:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8baca0968200) 00010000:00010000:2.0:1788587128.857730:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587128.857733:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857739:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab898e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857773:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab898d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a8b expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857816:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab898e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a8b expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.857824:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587128.857826:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587128.857828:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4e00, rc 0) 00000100:00100000:2.0:1788587128.858423:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:11634:x1875469182004096:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 1209us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587128.858431:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 211 00000100:00100000:2.0:1788587128.863038:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.863198:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182004480 00000100:00100000:3.0:1788587128.863210:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182004480 00000100:00100000:3.0:1788587128.863297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:3.0:1788587128.863307:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88340450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:2362:x1875469182004480:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587128.863324:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.863352:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4e00/0xc1a730b05ab898e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a8b expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.863375:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587128.863380:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.863443:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88340450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:2362:x1875469182004480:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 137us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.863467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:3.0:1788587128.865690:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587128.865791:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182004352 00000100:00100000:0.0:1788587128.865800:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182004352 00000100:00100000:0.0:1788587128.865888:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:0.0:1788587128.865898:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:11634:x1875469182004352:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587128.865919:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587128.865940:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab898f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a92 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.866042:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.866058:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.866067:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.866102:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587128.866131:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 60 pid: 5851 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587128.866147:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208206080:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587128.866234:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587128.873162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.873271:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182004608 00000100:00100000:1.0:1788587128.873281:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182004608 00010000:00010000:1.0:1788587128.873323:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 61 pid: 5851 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587128.873364:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:1.0:1788587128.873374:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:2361:x1875469182004608:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587128.873390:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587128.873396:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 61 pid: 5851 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.873410:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 61 pid: 5851 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.873442:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:1.0:1788587128.873448:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.873459:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.873467:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.873504:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587128.873567:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:2361:x1875469182004608:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 194us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.873574:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 82 00010000:00010000:2.0:1788587128.873802:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab898bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a7d expref: 60 pid: 5851 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587128.873820:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208206080:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587128.873840:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.873898:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.873904:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587128.873933:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788587128.874096:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab898f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.874123:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587128.874130:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587128.874133:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587128.874135:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98200, rc 0) 00000100:00100000:2.0:1788587128.874162:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:11634:x1875469182004352:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 8267us (8482us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788587128.874168:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 212 00000100:00100000:2.0:1788587128.877800:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587128.877897:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182004864 00000100:00100000:3.0:1788587128.877908:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182004864 00000100:00100000:3.0:1788587128.877968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:3.0:1788587128.877978:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:11634:x1875469182004864:12345-192.168.204.28@tcp:103:lfs.0 00010000:00010000:3.0:1788587128.877994:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587128.878020:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4400/0xc1a730b05ab89856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a68 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587128.878039:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587128.878044:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587128.878108:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:11634:x1875469182004864:12345-192.168.204.28@tcp:103:lfs.0 Request processed in 132us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587128.878116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1788587128.881452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.881560:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182004992 00000100:00100000:1.0:1788587128.881570:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182004992 00000100:00100000:1.0:1788587128.881639:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:1.0:1788587128.881650:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:11634:x1875469182004992:12345-192.168.204.28@tcp:58:lfs.0 00010000:00010000:1.0:1788587128.881794:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.881811:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.881824:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788587128.882072:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788587128.882165:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:11634:x1875469182004992:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 516us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.882173:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 213 00000100:00100000:0.0:1788587128.884893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587128.885362:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182005120 00000100:00100000:1.0:1788587128.885373:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182005120 00000100:00100000:1.0:1788587128.885432:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 214 00000100:00100000:1.0:1788587128.885443:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+59:11634:x1875469182005120:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587128.885464:0:7662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587128.885487:0:7662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2a99 expref: -99 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.885564:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.885575:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 60 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.885593:0:7662:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.885605:0:7662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 60 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.885631:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:1.0:1788587128.885634:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587128.885638:0:7662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 60 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587128.885646:0:7662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4800, rc 0) 00000100:00100000:1.0:1788587128.885699:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:11634:x1875469182005120:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 258us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587128.885706:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 214 00010000:00010000:0.0:1788587129.540054:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788587129.667117:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587129.667127:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587129.667165:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788587129.667171:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587129.667313:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9adf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208206208:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587129.667483:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788587129.682078:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.682323:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182005248 00000100:00100000:1.0:1788587129.682334:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182005248 00000100:00100000:1.0:1788587129.682391:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:1.0:1788587129.682402:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182005248:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788587129.682437:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788587129.682571:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182005248:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 171us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.682580:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 215 00000100:00100000:3.0:1788587129.685903:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9adf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208206208:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587129.686984:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.687152:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182005376 00000100:00100000:1.0:1788587129.687162:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182005376 00000100:00100000:1.0:1788587129.687221:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:1.0:1788587129.687232:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:11635:x1875469182005376:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788587129.687307:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687325:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687336:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687351:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687359:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687365:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687386:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687394:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687399:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587129.687453:0:7662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788587129.687458:0:7662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587129.687471:0:7662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687482:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687489:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687495:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687501:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587129.687505:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687513:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687525:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:1.0:1788587129.687527:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.687532:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687537:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89913 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687549:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687565:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687571:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687576:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587129.687579:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687586:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687749:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8baca1025a00) 00010000:00010000:1.0:1788587129.687753:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.687756:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687762:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab8991a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687777:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687782:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687787:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687791:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587129.687800:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687805:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.687813:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:1.0:1788587129.688580:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.688589:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.688935:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.689106:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:11635:x1875469182005376:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 1873us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.689116:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 216 00000100:00100000:0.0:1788587129.695460:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587129.695587:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182005632 00000100:00100000:2.0:1788587129.695602:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182005632 00000100:00100000:2.0:1788587129.695667:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:2.0:1788587129.695678:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+60:11635:x1875469182005632:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587129.695700:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587129.695722:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89928 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2aa0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.695830:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.695889:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.695902:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587129.695932:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788587129.696042:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696050:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696057:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696063:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587129.696067:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696075:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696087:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587129.696091:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788587129.696095:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696101:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab8992f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696146:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89928 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aa0 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696157:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:2.0:1788587129.696159:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587129.696170:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89928 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aa0 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.696180:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4a00, rc 0) 00000100:00100000:2.0:1788587129.696240:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182005632:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 565us (789us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788587129.696249:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 217 00000100:00100000:0.0:1788587129.700162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587129.700332:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182005760 00000100:00100000:2.0:1788587129.700343:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182005760 00000100:00100000:2.0:1788587129.700455:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:2.0:1788587129.700468:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182005760:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587129.700504:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587129.700615:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182005760:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 150us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587129.700622:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 218 00000100:00100000:3.0:1788587129.706255:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587129.706443:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182006016 00000100:00100000:2.0:1788587129.706454:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182006016 00000100:00100000:2.0:1788587129.706525:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:2.0:1788587129.706536:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182006016:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587129.706557:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587129.706560:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788587129.706588:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab898cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a84 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.706607:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587129.706612:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587129.706626:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8993d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2aa7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587129.707121:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788587129.707384:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89944 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.707399:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.707409:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89944 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.707462:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8993d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aa7 expref: 63 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.707477:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89944 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aa7 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.707485:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca0968200) 00010000:00010000:2.0:1788587129.707488:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587129.707490:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4a00, rc 0) 00000100:00100000:2.0:1788587129.707554:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+62:11635:x1875469182006016:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 1020us (1312us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788587129.707561:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 219 00000100:00100000:0.0:1788587129.714322:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.714561:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182006272 00000100:00100000:1.0:1788587129.714571:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182006272 00000100:00100000:1.0:1788587129.714640:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:1.0:1788587129.714652:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+62:11635:x1875469182006272:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788587129.714712:0:7662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587129.714740:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aa7 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.714762:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca0968200) 00010000:00010000:1.0:1788587129.714773:0:7662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587129.714795:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.714828:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715193:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715213:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715221:0:7662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715228:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715299:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715306:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715313:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715320:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587129.715324:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715332:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715340:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:1.0:1788587129.715351:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.715355:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715361:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4200/0xc1a730b05ab89952 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715371:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715377:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715383:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715388:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587129.715390:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715396:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715404:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x532fdc16 (ffff8baca1025a00) 00010000:00010000:1.0:1788587129.715406:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.715409:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.715414:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5800/0xc1a730b05ab89959 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x532fdc16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.715519:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182006272:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 869us (1207us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587129.715533:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 220 00000100:00100000:0.0:1788587129.721015:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.721234:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182006400 00000100:00100000:1.0:1788587129.721246:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182006400 00000100:00100000:1.0:1788587129.721313:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:1.0:1788587129.721324:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+61:11635:x1875469182006400:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587129.721346:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587129.721371:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.721408:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.721422:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.721434:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.721535:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 63 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.721554:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.721563:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:1.0:1788587129.721566:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788587129.721570:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4a00, rc 0) 00000100:00100000:1.0:1788587129.724110:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+62:11635:x1875469182006400:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 2776us (3094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.724140:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 221 00000100:00100000:2.0:1788587129.729647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587129.729785:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182006656 00000100:00100000:0.0:1788587129.729796:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182006656 00000100:00100000:0.0:1788587129.729890:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 222 00000100:00100000:0.0:1788587129.729901:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+62:11635:x1875469182006656:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587129.729991:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.730032:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.730044:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587129.730381:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788587129.730392:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451934548588ns, next at 452934545778ns, rc = 0 00000004:00010000:0.0:1788587129.730959:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6e09f65 reply state 000000001387b85d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.730970:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587129.732391:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+64:11635:x1875469182006656:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 2482us (2744us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788587129.732403:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 222 00010000:00010000:3.0:1788587129.743029:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.743048:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.743056:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.743078:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587129.743083:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.743091:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.743109:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:3.0:1788587129.743112:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788587129.743117:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587129.743123:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99400/0xc1a730b05ab8996e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587129.743400:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.743634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182006784 00000100:00100000:1.0:1788587129.743645:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182006784 00000100:00100000:1.0:1788587129.743755:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:1.0:1788587129.743766:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+63:11635:x1875469182006784:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587129.743789:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587129.743808:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2ab5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.743915:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.743931:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.743952:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:1.0:1788587129.743954:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788587129.743957:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5400, rc 0) 00000100:00100000:1.0:1788587129.744026:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+64:11635:x1875469182006784:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 261us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.744033:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 223 00000100:00100000:0.0:1788587129.749692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587129.749955:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182006912 00000100:00100000:3.0:1788587129.749966:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182006912 00000100:00080000:1.0:1788587129.750311:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587129.750364:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:2.0:1788587129.750377:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2361:x1875469182006912:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788587129.750756:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2361:x1875469182006912:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 382us (1085us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788587129.750765:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:2.0:1788587129.753563:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587129.754025:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182007168 00000100:00100000:3.0:1788587129.754037:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182007168 00000100:00100000:3.0:1788587129.754098:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:3.0:1788587129.754109:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+64:11635:x1875469182007168:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788587129.754431:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+65:11635:x1875469182007168:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 322us (876us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788587129.754439:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:3.0:1788587129.757017:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.757125:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182007424 00000100:00100000:1.0:1788587129.757135:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182007424 00000100:00100000:1.0:1788587129.757255:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 224 00000100:00100000:1.0:1788587129.757266:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+65:11635:x1875469182007424:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788587129.757397:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+65:11635:x1875469182007424:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 132us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.757405:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 224 00000100:00100000:0.0:1788587129.760557:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587129.760700:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182007552 00000100:00100000:2.0:1788587129.760710:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182007552 00000100:00100000:2.0:1788587129.761014:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00100000:2.0:1788587129.761026:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+65:11635:x1875469182007552:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587129.761046:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587129.761065:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8997c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2abc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.761133:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.761149:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.761160:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587129.761195:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587129.761309:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.761339:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4200/0xc1a730b05ab8997c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2abc expref: 67 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.761357:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2abc expref: 66 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.761381:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:2.0:1788587129.761384:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788587129.761388:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5c00, rc 0) 00000100:00100000:2.0:1788587129.761484:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+66:11635:x1875469182007552:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 461us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587129.761493:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 225 00000100:00100000:2.0:1788587129.771051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587129.771201:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182007680 00000100:00100000:0.0:1788587129.771211:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182007680 00000100:00100000:0.0:1788587129.771338:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:0.0:1788587129.771350:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+10:2362:x1875469182007680:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587129.771370:0:10779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587129.771393:0:10779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2ac3 expref: -99 pid: 10779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587129.771424:0:10779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bac79, blocks: 0x1 00010000:00010000:0.0:1788587129.771447:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=451s v=(0 0) 00010000:00010000:0.0:1788587129.771464:0:10779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587129.771475:0:10779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 11 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.771495:0:10779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 11 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.771510:0:10779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99600, rc 0) 00000100:00100000:0.0:1788587129.771576:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+11:2362:x1875469182007680:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 229us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.771583:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:2.0:1788587129.778947:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587129.779072:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182007936 00000100:00100000:0.0:1788587129.779081:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182007936 00000100:00100000:0.0:1788587129.779142:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 226 00000100:00100000:0.0:1788587129.779152:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+66:11635:x1875469182007936:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587129.779267:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+66:11635:x1875469182007936:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.779275:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 226 00000100:00100000:3.0:1788587129.784558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.785072:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182008064 00000100:00100000:1.0:1788587129.785083:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182008064 00000100:00100000:1.0:1788587129.785146:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:1.0:1788587129.785157:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+11:11635:x1875469182008064:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587129.785175:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587129.785194:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2aca expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.785227:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 12 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.785237:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587129.785240:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587129.785246:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.785282:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 12 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.785298:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 12 pid: 10779 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.785311:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6706:1875469208206336:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587129.785425:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587129.789270:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6706:1875469208206336:192.168.204.28@tcp:104: 00010000:00010000:1.0:1788587129.789313:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.789334:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4200, rc 0) 00000100:00100000:1.0:1788587129.789397:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:11635:x1875469182008064:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 4243us (4848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.789405:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:3.0:1788587129.792691:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.794372:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182008192 00000100:00100000:1.0:1788587129.794386:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182008192 00010000:00010000:1.0:1788587129.794435:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 12 pid: 10779 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.794484:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:1.0:1788587129.794494:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:2361:x1875469182008192:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587129.794513:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587129.794535:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 12 pid: 10779 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.794548:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 12 pid: 10779 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.794570:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab8998a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ac3 expref: 12 pid: 10779 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.794619:0:8474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587129.794623:0:8474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587129.794632:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.794642:0:8474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.794690:0:8474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.794706:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8474:1875469208206464:192.168.204.28@tcp:105: 00000100:00100000:1.0:1788587129.795175:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587129.810334:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587129.810480:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182008320 00000100:00100000:2.0:1788587129.810489:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182008320 00002000:00100000:2.0:1788587129.810540:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8bacb4b4d180 x1875469182008320/t0(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:445/0 lens 504/0 e 0 to 0 dl 1788587140 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587129.810551:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacb4b4d180 with x1875469182008320 ext(0->12) 00002000:00010000:2.0:1788587129.810558:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacb4b4d180 00000100:00100000:2.0:1788587129.810600:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:2.0:1788587129.810609:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+12:2362:x1875469182008320:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788587129.811429:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469182008320:12345-192.168.204.28@tcp:4:lhsmtool_posix.0 Request processed in 816us (1101us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788587129.811439:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00002000:00100000:2.0:1788587129.811450:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8bacb4b4d180 x1875469182008320/t4294967320(0) o4->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:445/0 lens 504/448 e 0 to 0 dl 1788587140 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788587129.811459:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacb4b4d180 with x1875469182008320 ext(0->12) 00002000:00010000:2.0:1788587129.811463:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacb4b4d180 00000100:00100000:1.0:1788587129.813389:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8474:1875469208206464:192.168.204.28@tcp:105: 00010000:00010000:1.0:1788587129.813427:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587129.813486:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2361:x1875469182008192:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 18992us (20815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.813497:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:3.0:1788587129.817651:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587129.818004:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182008448 00000100:00100000:2.0:1788587129.818016:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182008448 00000100:00100000:2.0:1788587129.818077:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 227 00000100:00100000:2.0:1788587129.818087:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+66:11635:x1875469182008448:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788587129.864502:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587129.864528:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208206592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587129.864610:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587129.864760:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208206592 00000100:00100000:0.0:1788587129.864768:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208206592 00000100:00100000:0.0:1788587129.864826:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788587129.864863:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac9071c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208206592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587129.864898:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587129.864950:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac9071c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208206592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.864957:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788587129.864988:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587129.865025:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208206592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587129.865080:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208206720:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865110:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587129.865146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208206720 00000100:00100000:0.0:1788587129.865150:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208206720 00000100:00100000:0.0:1788587129.865175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788587129.865181:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208206720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865214:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208206720:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.865220:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788587129.865254:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208206720:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865287:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208206848:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865312:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587129.865341:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208206848 00000100:00100000:0.0:1788587129.865344:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208206848 00000100:00100000:0.0:1788587129.865367:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788587129.865374:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208206848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865406:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208206848:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.865411:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788587129.865436:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208206848:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865465:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208206976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865488:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587129.865528:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208206976 00000100:00100000:0.0:1788587129.865532:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208206976 00000100:00100000:0.0:1788587129.865557:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788587129.865563:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208206976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865597:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208206976:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.865603:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1788587129.865617:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587129.865635:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208206976:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865662:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587129.865669:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208207104:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865705:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587129.865729:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208207104 00000100:00100000:0.0:1788587129.865733:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208207104 00000100:00100000:0.0:1788587129.865760:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788587129.865766:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208207104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865798:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208207104:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.865805:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1788587129.865819:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587129.865876:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208207104:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865933:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208207232:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.865959:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587129.865990:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208207232 00000100:00100000:0.0:1788587129.865994:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208207232 00000100:00100000:0.0:1788587129.866018:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587129.866024:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208207232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.866066:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208207232:12345-0@lo:400:kworker.0 Request processed in 42us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.866072:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788587129.866098:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208207232:0@lo:400:kworker.0 00000100:00100000:0.0:1788587129.877644:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+66:11635:x1875469182008448:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 59547us (59990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.877658:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 227 00000001:00080000:3.0:1788587129.880237:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1788587129.880251:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788587129.880292:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bacb596fa80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788587129.880297:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bacb4c77300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bacb596f300 00000020:00080000:3.0:1788587129.880300:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bacb4c77b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bacbf9f3c00 00000004:00080000:3.0:1788587129.880329:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788587129.880347:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bac86004300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788587129.880349:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8baca13af100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bac86004a80 00000020:00080000:3.0:1788587129.880352:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8baca13af500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bacb4b3a000 00000004:00080000:3.0:1788587129.880391:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1788587129.880407:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000100:00100000:1.0:1788587129.880701:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587129.880722:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac9071e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208207360:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788587129.881255:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587129.881312:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208207488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788587129.881341:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587129.881373:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208207360 00000100:00100000:1.0:1788587129.881379:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208207360 00000100:00100000:1.0:1788587129.881421:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208207488 00000100:00100000:1.0:1788587129.881424:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208207488 00000100:00100000:1.0:1788587129.881442:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587129.881450:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875469208207360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788587129.881475:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788587129.881501:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.881524:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.881534:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788587129.881539:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587129.881544:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.881574:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.881588:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 12 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.881600:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6706:1875469208207616:192.168.204.28@tcp:104: 00000100:00100000:1.0:1788587129.881664:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacc2062d80 going to sleep for 11 seconds 00000020:00080000:0.0:1788587129.881790:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788587129.882214:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788587129.882301:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587129.882314:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc98c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875469208207488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788587129.882445:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788587129.882449:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788587129 00002000:00010000:1.0:1788587129.882451:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788587129.882453:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788587129 -> 1788587129 00002000:00010000:1.0:1788587129.882455:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788587129.882500:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc98c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1875469208207488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (1157us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788587129.882507:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788587129.882932:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bacb5b83b80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788587129.882940:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208207488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788587129.883279:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.884336:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182008576 00000100:00100000:1.0:1788587129.884349:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182008576 00000100:00100000:1.0:1788587129.884408:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:1.0:1788587129.884417:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+13:2362:x1875469182008576:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788587129.888282:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587129.888308:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208207744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788587129.888386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587129.888450:0:10779:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788587129.888460:0:10779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788587129.890400:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208207744 00000100:00100000:1.0:1788587129.890414:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208207744 00000100:00100000:0.0:1788587129.890609:0:12608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788587129.890622:0:12608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3312:x1875469208207744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788587129.890657:0:12608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788587129.890689:0:12608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bac77, atime: 0x6a9bac78, ctime: 0x6a9bac77, blocks: 0x1 00010000:00010000:0.0:1788587129.890697:0:12608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.890714:0:12608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=452s v=(0 0) 00010000:00010000:0.0:1788587129.890719:0:12608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587129.890726:0:12608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.891714:0:12608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.891728:0:12608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.891989:0:12608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.892011:0:12608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587129.892552:0:12608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3312:x1875469208207744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1929us (4161us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788587129.892562:0:12608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1788587129.893229:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587129.893239:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.893251:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587129.893256:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.893267:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.893295:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.893303:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009020adff/0xc1a730b05ab8999f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.893325:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587129.893327:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587129.893329:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788587129.900438:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bac912e8a80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788587129.900456:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208207744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788587129.912446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587129.912484:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182008704 00000100:00100000:1.0:1788587129.912492:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182008704 00010000:00010000:1.0:1788587129.912532:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 14 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.912569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:1.0:1788587129.912578:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469182008704:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587129.912595:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587129.912601:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 14 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.912614:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 14 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.912643:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587129.912661:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587129.912668:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.912678:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.912700:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587129.912748:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+14:2362:x1875469182008704:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 170us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.912756:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00010000:00010000:0.0:1788587129.912972:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab8975a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a29 expref: 13 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.912987:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6706:1875469208207616:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587129.913007:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.913018:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.913041:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.913050:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.913058:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.913081:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587129.913643:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1875469208207360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32191us (32389us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788587129.913652:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1788587129.915542:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587129.915556:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.915568:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587129.915573:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.915585:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.915625:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.915634:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.915683:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587129.915685:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587129.915687:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788587129.915757:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bac9071e680/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788587129.915766:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac9071e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208207360:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788587129.952217:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1788587129.952236:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788587129.952243:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:1.0:1788587129.952403:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469182008576:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 67980us (69119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.952415:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:1.0:1788587129.957297:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587129.957423:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182008960 00000100:00100000:0.0:1788587129.957432:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182008960 00000100:00100000:0.0:1788587129.957494:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 228 00000100:00100000:0.0:1788587129.957504:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11635:x1875469182008960:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788587129.957557:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587129.958246:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2abc expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.958267:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:0.0:1788587129.958284:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587129.958320:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.958334:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.958345:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788587129.958584:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009af76907 reply state 00000000d98f8b7d transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.958675:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788587129.959334:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:11635:x1875469182008960:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 1829us (2043us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788587129.959343:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 228 00000100:00100000:0.0:1788587129.966400:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587129.967094:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182009088 00000100:00100000:2.0:1788587129.967105:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182009088 00000100:00100000:2.0:1788587129.967170:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:2.0:1788587129.967180:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2361:x1875469182009088:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788587129.967408:0:10779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788587129.967413:0:10779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788587129 -> 1788587128 00002000:00010000:2.0:1788587129.967416:0:10779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788587128 00002000:00010000:2.0:1788587129.967418:0:10779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788587129 -> 1788587128 00002000:00010000:2.0:1788587129.967420:0:10779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788587129.967494:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469182009088:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 315us (1107us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788587129.967503:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:3.0:1788587129.971692:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:1.0:1788587129.972126:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.972140:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.972148:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.972154:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587129.972159:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.972166:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.972183:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:1.0:1788587129.972186:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587129.972190:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.972212:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98600/0xc1a730b05ab899a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.974570:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182009344 00000100:00100000:0.0:1788587129.974657:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182009344 00000100:00100000:0.0:1788587129.975139:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 229 00000100:00100000:0.0:1788587129.975151:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:11635:x1875469182009344:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788587129.975218:0:7662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.975235:0:7662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.975243:0:7662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.975294:0:7662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.975308:0:7662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 20 pid: 5851 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.975321:0:7662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208207872:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587129.975425:0:7662:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587129.979757:0:7662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7662:1875469208207872:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587129.979789:0:7662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587129.981618:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587129.983399:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182009472 00000100:00100000:0.0:1788587129.983416:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182009472 00010000:00010000:0.0:1788587129.983465:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 21 pid: 5851 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.983544:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:0.0:1788587129.983555:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:2361:x1875469182009472:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587129.983570:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587129.983578:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 21 pid: 5851 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.983602:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 21 pid: 5851 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.983645:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4a00/0xc1a730b05ab89967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aae expref: 21 pid: 5851 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.983661:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:0.0:1788587129.983667:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.983677:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.983697:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.983733:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587129.983810:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:2361:x1875469182009472:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 257us (2200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.983818:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00010000:00010000:2.0:1788587129.983907:0:7662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.983916:0:7662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.983947:0:7662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.983954:0:7662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.983961:0:7662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.983975:0:7662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587129.983980:0:7662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.983988:0:7662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.983998:0:7662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:2.0:1788587129.984001:0:7662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788587129.984005:0:7662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587129.984011:0:7662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98000/0xc1a730b05ab899ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587129.984052:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbbcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11635:x1875469182009344:12345-192.168.204.28@tcp:55:lhsmtool_posix.0 Request processed in 8905us (12372us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788587129.984060:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 229 00000100:00100000:3.0:1788587129.992158:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587129.992370:0:12608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182009600 00000100:00100000:0.0:1788587129.992383:0:12608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182009600 00000100:00100000:0.0:1788587129.992445:0:12608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:0.0:1788587129.992455:0:12608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2360:x1875469182009600:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788587129.992500:0:12608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.992522:0:12608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.992551:0:12608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788587129.992555:0:12608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587129.992560:0:12608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.992599:0:12608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.992619:0:12608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 8 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.992636:0:12608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12608:1875469208208000:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587129.992734:0:12608:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587129.995374:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587129.995615:0:12608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12608:1875469208208000:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587129.995643:0:12608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.995723:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182009728 00000100:00100000:1.0:1788587129.995731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182009728 00010000:00010000:1.0:1788587129.996234:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 9 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587129.996315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:1.0:1788587129.996326:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+9:2362:x1875469182009728:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587129.996342:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587129.996365:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 9 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.996379:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 9 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.996403:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c48078ad/0xc1a730b05ab89991 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aca expref: 9 pid: 6706 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.996420:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587129.996424:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788587129.996431:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.996441:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587129.996485:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587129.996548:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469182009728:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 223us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587129.996556:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00010000:00010000:0.0:1788587129.996880:0:12608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996889:0:12608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996925:0:12608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996941:0:12608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996949:0:12608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996956:0:12608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587129.996961:0:12608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996970:0:12608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996983:0:12608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587129.996990:0:12608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a2908ea/0xc1a730b05ab899b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587129.997049:0:12608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469182009600:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 4594us (4898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587129.997058:0:12608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 70 00000100:00100000:3.0:1788587130.005397:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587130.005562:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182009984 00000100:00100000:2.0:1788587130.005573:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182009984 00000100:00100000:2.0:1788587130.005698:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 230 00000100:00100000:2.0:1788587130.005709:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11635:x1875469182009984:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587130.005799:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.005817:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.005869:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.006102:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.006115:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.006123:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.006155:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.006169:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 20 pid: 5850 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587130.006184:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae560e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208208128:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587130.006260:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacaf1b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587130.015570:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae560e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208208128:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587130.015603:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788587130.016676:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587130.017418:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587130.017492:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182010112 00000100:00100000:1.0:1788587130.017502:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182010112 00010000:00010000:1.0:1788587130.017541:0:8474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 21 pid: 5850 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587130.017582:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:1.0:1788587130.017597:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88341450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:2362:x1875469182010112:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788587130.017612:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587130.017619:0:8474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 21 pid: 5850 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.017632:0:8474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 21 pid: 5850 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.017653:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab5400/0xc1a730b05ab89975 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ab5 expref: 21 pid: 5850 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.017667:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:1.0:1788587130.017672:0:8474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.017682:0:8474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.017703:0:8474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.017745:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788587130.017804:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88341450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:2362:x1875469182010112:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 208us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.017812:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00010000:00010000:2.0:1788587130.018453:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.018463:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788587130.018670:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788587130.023507:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788587130.023603:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788587130.034122:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae560e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875469208208256:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788587130.034201:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587130.034302:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ec3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587130.034434:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208208256 00000100:00100000:0.0:1788587130.034442:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208208256 00000100:00100000:0.0:1788587130.034546:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788587130.034555:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875469208208256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788587130.034706:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875469208208256:12345-0@lo:1000:mdt00_000.0 Request processed in 151us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587130.034713:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587130.035404:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788587130.035411:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788587130.035433:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bacb5b83b80, transno 4294967321 00000100:00100000:3.0:1788587130.035454:0:5850:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bac9071e680 x1875469208207360/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788587145 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587130.035478:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae560e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875469208208256:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788587130.036367:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788587130.036451:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac8309b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875469208208384:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788587130.036503:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587130.037112:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ec600 going to sleep for 11 seconds 00000100:00100000:0.0:1788587130.037568:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208208384 00000100:00100000:0.0:1788587130.037577:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208208384 00000100:00100000:0.0:1788587130.037634:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587130.037644:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875469208208384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788587130.038185:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1875469208208384:12345-0@lo:1000:mdt00_000.0 Request processed in 541us (1679us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788587130.038193:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587130.038389:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac8309b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875469208208384:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788587130.038430:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038440:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038447:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038452:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587130.038456:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038464:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038479:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8baca1025600) 00010000:00010000:3.0:1788587130.038482:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587130.038487:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038493:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab899c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038543:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038549:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038555:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038560:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587130.038563:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038569:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038578:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587130.038581:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587130.038656:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 23 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.038668:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 23 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.039044:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 23 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.039083:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 23 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587130.039108:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208208512:192.168.204.28@tcp:105: 00000100:00100000:3.0:1788587130.039234:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacbb9ec600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587130.044594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587130.044900:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5947800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875469208208512:192.168.204.28@tcp:105: 00010000:00010000:0.0:1788587130.044927:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.044949:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4000/0xc1a730b05ab89905 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.044984:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.044999:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045012:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045024:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045047:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045055:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045061:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587130.045066:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045074:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045087:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:0.0:1788587130.045090:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587130.045094:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045099:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99a00/0xc1a730b05ab899c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045109:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045115:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.045120:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.046462:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587130.046482:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.046493:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.046509:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:0.0:1788587130.046512:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587130.046516:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.046524:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab899bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587130.046838:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182010240 00000100:00100000:2.0:1788587130.046863:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182010240 00000100:00100000:2.0:1788587130.046929:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:2.0:1788587130.046939:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11634:x1875469182010240:12345-192.168.204.28@tcp:49:lfs.0 00000100:00100000:2.0:1788587130.047082:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+24:11634:x1875469182010240:12345-192.168.204.28@tcp:49:lfs.0 Request processed in 144us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.047090:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:0.0:1788587130.047404:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11635:x1875469182009984:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 41696us (42015us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788587130.047413:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 230 00000020:00080000:0.0:1788587130.047417:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788587130.048099:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587130.048104:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587130.048589:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788587130.048598:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788587130.053278:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587130.053367:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587130.053428:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182010496 00000100:00100000:3.0:1788587130.053438:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182010496 00000100:00100000:3.0:1788587130.053497:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:3.0:1788587130.053508:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84660050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+23:11635:x1875469182010496:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788587130.054562:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788587130.054835:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788587130.055208:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.055227:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.055239:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.055248:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.055255:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.055261:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.055283:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788587130.055399:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84660050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:11635:x1875469182010496:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1889us (2127us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788587130.055408:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000020:00080000:3.0:1788587130.055414:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587130.055600:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587130.055608:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.055615:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587130.055619:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.055627:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.055642:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:1.0:1788587130.055645:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788587130.055650:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.055656:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587130.055685:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587130.055687:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587130.055689:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587130.056164:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182010752 00000100:00100000:2.0:1788587130.056174:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182010752 00000100:00100000:2.0:1788587130.056234:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 231 00000100:00100000:2.0:1788587130.056243:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:11634:x1875469182010752:12345-192.168.204.28@tcp:58:lfs.0 00000040:00080000:2.0:1788587130.056453:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788587130.056509:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:11634:x1875469182010752:12345-192.168.204.28@tcp:58:lfs.0 Request processed in 267us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.056515:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 231 00000100:00100000:3.0:1788587130.094028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587130.094482:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182010880 00000100:00100000:0.0:1788587130.094493:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182010880 00000100:00100000:0.0:1788587130.094583:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 232 00000100:00100000:0.0:1788587130.094602:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+25:11637:x1875469182010880:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587130.094626:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587130.094645:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab899d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2ad1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.094706:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.094750:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.094764:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.094782:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.094789:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.094796:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.095090:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.095101:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.095111:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.095358:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587130.095373:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 26 pid: 5852 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587130.095398:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208208640:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587130.095486:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a280c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587130.100475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587130.100560:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182011136 00000100:00100000:1.0:1788587130.100583:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182011136 00000100:00100000:1.0:1788587130.100656:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:1.0:1788587130.100665:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:5602:x1875469182011136:12345-192.168.204.28@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788587130.101239:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:5602:x1875469182011136:12345-192.168.204.28@tcp:35:ldlm_bl.0 Request processed in 463us (662us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788587130.101248:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 63 00000100:00100000:3.0:1788587130.101344:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875469208208640:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587130.101370:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587130.104531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587130.104641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182011264 00000100:00100000:2.0:1788587130.104651:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182011264 00010000:00010000:2.0:1788587130.105382:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 28 pid: 5852 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587130.105429:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:2.0:1788587130.105441:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:2361:x1875469182011264:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587130.105469:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587130.105476:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 28 pid: 5852 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.105490:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 28 pid: 5852 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.105513:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98200/0xc1a730b05ab898f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a92 expref: 28 pid: 5852 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.105529:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587130.105534:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.105543:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.105550:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.105641:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587130.105700:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:2361:x1875469182011264:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 262us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.105707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 88 00010000:00010000:3.0:1788587130.106597:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587130.106609:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587130.106813:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788587130.106818:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587130.107091:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107106:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107220:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107228:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107235:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107240:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587130.107245:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107253:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107267:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587130.107270:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587130.107669:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107678:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99800/0xc1a730b05ab899de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107694:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107700:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107706:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107718:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98c00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587130.107722:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107728:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107800:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8bac90439d00) 00010000:00010000:2.0:1788587130.107804:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587130.107808:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107814:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98c00/0xc1a730b05ab899e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107973:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab899d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ad1 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107989:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ad1 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587130.107996:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587130.107998:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587130.108000:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98e00, rc 0) 00000100:00100000:2.0:1788587130.108115:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:11637:x1875469182010880:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 13521us (14094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587130.108203:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 232 00000100:00100000:0.0:1788587130.372106:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587130.372132:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208208768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587130.372205:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587130.372320:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208208768 00000100:00100000:1.0:1788587130.372331:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208208768 00000100:00100000:1.0:1788587130.372401:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788587130.372412:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208208768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587130.372451:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587130.372502:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208208768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587130.372509:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788587130.372558:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208208768:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788587130.372625:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788587130.565691:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587131.076069:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788587131.076087:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788587131.076125:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788587131.076131:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587131.076281:0:11708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae560380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208208896:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788587131.076379:0:11708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb4d8e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587131.090979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587131.091025:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182011392 00000100:00100000:0.0:1788587131.091034:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182011392 00000100:00100000:0.0:1788587131.091088:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 233 00000100:00100000:0.0:1788587131.091097:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:11648:x1875469182011392:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587131.091133:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587131.091238:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:11648:x1875469182011392:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 141us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587131.091245:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 233 00000100:00100000:3.0:1788587131.091594:0:11708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae560380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11708:1875469208208896:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788587131.094247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587131.094470:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182011648 00000100:00100000:3.0:1788587131.094481:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182011648 00000100:00100000:3.0:1788587131.094540:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:3.0:1788587131.094550:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+26:11648:x1875469182011648:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587131.094581:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587131.094604:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab899f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2ad8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.094718:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.094734:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.094760:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587131.094775:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788587131.094951:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab899f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ad8 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.094973:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ad8 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.094982:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587131.094985:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587131.094990:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050800, rc 0) 00000100:00100000:3.0:1788587131.095051:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:11648:x1875469182011648:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 502us (813us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788587131.095058:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 234 00000100:00100000:3.0:1788587131.100008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587131.100159:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182011776 00000100:00100000:2.0:1788587131.100169:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182011776 00000100:00100000:2.0:1788587131.100235:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1788587131.100245:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:2361:x1875469182011776:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587131.100261:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587131.100285:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab899fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ad8 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.100305:0:8474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587131.100311:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587131.100372:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:2361:x1875469182011776:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587131.100379:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:0.0:1788587131.119148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587131.140476:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182012032 00000100:00100000:2.0:1788587131.140492:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182012032 00000100:00100000:2.0:1788587131.140572:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 235 00000100:00100000:2.0:1788587131.140584:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+27:11648:x1875469182012032:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788587131.140662:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140680:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140708:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140939:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140948:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140955:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140961:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587131.140966:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140974:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.140986:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587131.140989:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587131.140994:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587131.141001:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4a00/0xc1a730b05ab89a08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587131.141152:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:11648:x1875469182012032:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 570us (22013us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788587131.141161:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 235 00000040:00080000:1.0:1788587131.142931:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587131.142941:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587131.143438:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788587131.143447:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788587131.144240:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587131.144684:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182012288 00000100:00100000:2.0:1788587131.144694:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182012288 00000100:00100000:2.0:1788587131.144758:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 64 00000100:00100000:2.0:1788587131.144768:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+28:11648:x1875469182012288:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788587131.145039:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:11648:x1875469182012288:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 271us (804us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788587131.145047:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 64 00000040:00080000:0.0:1788587131.166052:0:12646:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788587131.166062:0:12646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788587131.166107:0:12646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788587131.166113:0:12646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587131.439201:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587131.439333:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182012544 00000100:00100000:3.0:1788587131.439344:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182012544 00000100:00100000:3.0:1788587131.439406:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00100000:3.0:1788587131.439416:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+29:11661:x1875469182012544:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587131.439441:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587131.439462:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2adf expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.439571:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89a16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.439594:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89a16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.439608:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89a16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587131.439620:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788587131.439757:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050200/0xc1a730b05ab89a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2adf expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.439777:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89a16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2adf expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.439786:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587131.439789:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788587131.439793:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051200, rc 0) 00000100:00100000:3.0:1788587131.439900:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:11661:x1875469182012544:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 485us (718us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788587131.439907:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 236 00000100:00100000:2.0:1788587131.443603:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587131.443669:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182012672 00000100:00100000:3.0:1788587131.443680:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182012672 00000100:00100000:3.0:1788587131.443738:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 237 00000100:00100000:3.0:1788587131.443748:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:11661:x1875469182012672:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:3.0:1788587131.443829:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443885:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443910:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443938:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443945:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443953:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443958:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587131.443963:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443971:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443981:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:3.0:1788587131.443984:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587131.443988:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587131.443995:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050e00/0xc1a730b05ab89a24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587131.444062:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:11661:x1875469182012672:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 315us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587131.444069:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 237 00010000:00010000:1.0:1788587131.587330:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587131.621298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587131.623205:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182012800 00000100:00100000:0.0:1788587131.623296:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182012800 00000100:00100000:0.0:1788587131.623375:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00100000:0.0:1788587131.623388:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469182012800:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1788587131.628524:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587131.628563:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061e1129c/0xc1a730b05ab89a2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2ae6 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587131.628597:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9bac78, atime: 0x6a9bac78, ctime: 0x6a9bac78, blocks: 0xb 00010000:00010000:0.0:1788587131.628617:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1788587131.628622:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587131.628635:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061e1129c/0xc1a730b05ab89a2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ae6 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587131.628654:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061e1129c/0xc1a730b05ab89a2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ae6 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587131.628666:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587131.628740:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2362:x1875469182012800:12345-192.168.204.28@tcp:101:cat.0 Request processed in 5354us (7450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587131.628748:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 71 00000100:00080000:2.0:1788587131.630889:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587131.634619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587131.635054:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182012928 00000100:00100000:3.0:1788587131.635077:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182012928 00002000:00100000:3.0:1788587131.635124:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8bacb5b80000 x1875469182012928/t0(0) o3->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:447/0 lens 488/0 e 0 to 0 dl 1788587142 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587131.635135:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacb5b80000 with x1875469182012928 ext(0->4095) 00002000:00010000:3.0:1788587131.635141:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacb5b80000 00000100:00100000:3.0:1788587131.635163:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:3.0:1788587131.635171:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469182012928:12345-192.168.204.28@tcp:3:cat.0 00000100:00100000:3.0:1788587131.636027:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2361:x1875469182012928:12345-192.168.204.28@tcp:3:cat.0 Request processed in 851us (1412us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788587131.636038:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00002000:00100000:3.0:1788587131.636049:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8bacb5b80000 x1875469182012928/t0(0) o3->4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8@192.168.204.28@tcp:447/0 lens 488/4536 e 0 to 0 dl 1788587142 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788587131.636058:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bacb5b80000 with x1875469182012928 ext(0->4095) 00002000:00010000:3.0:1788587131.636062:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bacb5b80000 00000100:00100000:2.0:1788587131.917761:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587131.917817:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587131.917885:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587131.917944:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013568 00000100:00100000:3.0:1788587131.917954:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013568 00000100:00100000:3.0:1788587131.918025:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:3.0:1788587131.918036:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469182013568:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587131.918065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587131.918102:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587131.918109:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2360:x1875469182013568:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587131.918116:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 176 00000100:00100000:3.0:1788587131.918131:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013184 00000100:00100000:3.0:1788587131.918134:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013184 00000100:00100000:3.0:1788587131.918153:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00100000:3.0:1788587131.918159:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:2360:x1875469182013184:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587131.918202:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+31:2360:x1875469182013184:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 42us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587131.918219:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 177 00000100:00080000:3.0:1788587131.918247:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587131.918279:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013312 00000100:00100000:3.0:1788587131.918282:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013312 00000100:00100000:1.0:1788587131.918656:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013056 00000100:00100000:1.0:1788587131.918662:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013056 00000100:00100000:1.0:1788587131.918694:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 305 00000100:00100000:1.0:1788587131.918701:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469182013056:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587131.918740:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469182013056:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 39us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587131.918744:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013440 00000100:00100000:3.0:1788587131.918747:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013440 00000100:00100000:1.0:1788587131.918747:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 305 00000100:00100000:3.0:1788587131.918775:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:3.0:1788587131.918781:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2360:x1875469182013312:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587131.918820:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+8:2360:x1875469182013312:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 40us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587131.918827:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:3.0:1788587131.918870:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:3.0:1788587131.918879:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469182013440:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587131.918901:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469182013440:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587131.918907:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00080000:3.0:1788587131.918922:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788587132.522487:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788587132.522504:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:1.0:1788587132.616290:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587133.635418:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587134.660063:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587134.983788:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208209024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587134.983889:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587134.984220:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209024 00000100:00100000:0.0:1788587134.984228:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209024 00000100:00100000:0.0:1788587134.984282:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788587134.984291:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208209024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587134.984322:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587134.984371:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875469208209024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.984388:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788587134.984441:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208209024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788587134.986363:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587134.988031:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208209408:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.988097:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587134.988148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209408 00000100:00100000:3.0:1788587134.988157:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209408 00000100:00100000:3.0:1788587134.988212:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788587134.988221:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208209408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.988285:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208209408:12345-0@lo:400:kworker.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587134.988293:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1788587134.988316:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587134.988349:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208209408:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.988382:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587134.988388:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208209536:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.988411:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587134.988437:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209536 00000100:00100000:3.0:1788587134.988440:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209536 00000100:00100000:3.0:1788587134.988469:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788587134.988476:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208209536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.988509:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208209536:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587134.988515:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1788587134.988531:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587134.988547:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208209536:0@lo:400:kworker.0 00000100:00100000:1.0:1788587134.993055:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208209280:0@lo:400:kworker.0 00000100:00100000:1.0:1788587134.993151:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587134.993349:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788587134.993358:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208209152:0@lo:400:kworker.0 00000100:00100000:1.0:1788587134.993389:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587134.993424:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208209664:0@lo:400:kworker.0 00000100:00100000:1.0:1788587134.993451:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587134.994427:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209280 00000100:00100000:3.0:1788587134.994438:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209280 00000100:00100000:3.0:1788587134.994500:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788587134.994511:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208209280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.995658:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209152 00000100:00100000:0.0:1788587134.995667:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209152 00000100:00100000:0.0:1788587134.995713:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788587134.995723:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208209152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587134.995804:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3313:x1875469208209152:12345-0@lo:400:kworker.0 Request processed in 83us (2412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587134.995812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788587134.997755:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208209280:12345-0@lo:400:kworker.0 Request processed in 3222us (4581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587134.997768:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788587134.997921:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209664 00000100:00100000:2.0:1788587134.997930:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209664 00000100:00100000:2.0:1788587134.997987:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788587134.997997:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208209664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587134.998074:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208209664:12345-0@lo:400:kworker.0 Request processed in 79us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587134.998080:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788587134.999406:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208209152:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.999446:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788587134.999452:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788587134.999473:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bac912e8a80, transno 4294967310 00000100:00100000:3.0:1788587134.999484:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac83052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208209664:0@lo:400:kworker.0 00000100:00100000:3.0:1788587134.999499:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208209280:0@lo:400:kworker.0 00000100:00080000:3.0:1788587134.999584:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788587135.059546:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788587135.059565:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788587135.078205:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000020:00080000:3.0:1788587135.078221:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788587135.078231:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1788587135.078239:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000001:00080000:3.0:1788587135.078256:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788587135.078269:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bacbb9ecf00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788587135.078275:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac862d8c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bacbb9ec3c0 00000020:00080000:3.0:1788587135.078279:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bac862d8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bacbf97e800 00000020:00080000:1.0:1788587135.078343:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788587135.078535:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788587135.493985:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208209792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587135.494057:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587135.494134:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209792 00000100:00100000:1.0:1788587135.494141:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209792 00000100:00100000:1.0:1788587135.494189:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788587135.494198:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208209792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587135.494232:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587135.494287:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208209792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587135.494293:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788587135.494345:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208209792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788587135.686513:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587136.707919:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587137.037273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587137.037315:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587137.037338:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587137.037363:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587137.037402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587137.037431:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182014208 00000100:00100000:2.0:1788587137.037441:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182014208 00000100:00100000:2.0:1788587137.037512:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013824 00000100:00100000:2.0:1788587137.037515:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013824 00000100:00100000:2.0:1788587137.037540:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 181 00000100:00100000:2.0:1788587137.037550:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469182014208:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587137.037637:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+5:2359:x1875469182014208:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 90us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587137.037646:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 181 00000100:00100000:2.0:1788587137.037664:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 182 00000100:00100000:2.0:1788587137.037670:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2359:x1875469182013824:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587137.037708:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2359:x1875469182013824:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587137.037714:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 182 00000100:00100000:2.0:1788587137.037737:0:12608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013952 00000100:00100000:2.0:1788587137.037740:0:12608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013952 00000100:00100000:2.0:1788587137.037780:0:12608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182014080 00000100:00100000:2.0:1788587137.037783:0:12608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182014080 00000100:00100000:2.0:1788587137.037802:0:12608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00100000:2.0:1788587137.037809:0:12608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2359:x1875469182013952:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587137.037838:0:12608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2359:x1875469182013952:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587137.037879:0:12608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00100000:2.0:1788587137.037891:0:12608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:2.0:1788587137.037897:0:12608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469182014080:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587137.037930:0:12608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2359:x1875469182014080:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 33us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587137.037936:0:12608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00080000:2.0:1788587137.037951:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587137.037955:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587137.037958:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587137.038393:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182013696 00000100:00100000:0.0:1788587137.038399:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182013696 00000100:00100000:0.0:1788587137.038426:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 307 00000100:00100000:0.0:1788587137.038434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469182013696:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587137.038475:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469182013696:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 43us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587137.038481:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 307 00010000:00010000:1.0:1788587137.734576:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587138.307818:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788587138.307828:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587138.308149:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788587138.308156:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788587138.436595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587138.436688:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182014336 00000100:00100000:3.0:1788587138.436698:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182014336 00000100:00100000:3.0:1788587138.436757:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:3.0:1788587138.436766:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11314:x1875469182014336:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788587138.436916:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11314:x1875469182014336:12345-192.168.204.28@tcp:60:lhsmtool_posix.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587138.436924:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 238 00000100:00100000:2.0:1788587138.441549:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587138.442521:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182014592 00000100:00100000:1.0:1788587138.442535:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182014592 00000100:00100000:1.0:1788587138.442603:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 65 00000100:00100000:1.0:1788587138.442626:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:11314:x1875469182014592:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788587138.443016:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:11314:x1875469182014592:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 390us (1474us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788587138.443024:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 65 00010000:00010000:1.0:1788587138.755993:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587139.055250:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587139.055450:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182014720 00000100:00100000:2.0:1788587139.055461:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182014720 00000100:00100000:2.0:1788587139.055546:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00100000:2.0:1788587139.055560:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+5:12112:x1875469182014720:12345-192.168.204.28@tcp:101:lsof.0 00010000:00010000:2.0:1788587139.055581:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587139.055607:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2aed expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587139.055686:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89a39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587139.055701:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587139.055718:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587139.055760:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587139.055764:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587139.055787:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89a39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587139.055833:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5c00/0xc1a730b05ab89a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aed expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587139.055890:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89a39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aed expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587139.055899:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:2.0:1788587139.055902:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587139.055906:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5200, rc 0) 00000100:00100000:2.0:1788587139.055975:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab703820-03cd-48f7-bca8-7e3164455d6c+6:12112:x1875469182014720:12345-192.168.204.28@tcp:101:lsof.0 Request processed in 420us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587139.055983:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 239 00000100:00080000:3.0:1788587139.056648:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788587139.780185:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587140.099324:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208209920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587140.099406:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587140.099615:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208210176:0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.099663:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587140.099684:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587140.099690:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208210304:0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.099713:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.100023:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208210048:0@lo:400:kworker.0 00000100:00100000:1.0:1788587140.100062:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.100085:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208210560:0@lo:400:kworker.0 00000100:00100000:1.0:1788587140.100110:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.100128:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587140.100134:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208210432:0@lo:400:kworker.0 00000100:00100000:1.0:1788587140.100157:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587140.100445:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210560 00000100:00100000:3.0:1788587140.100454:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210560 00000100:00100000:3.0:1788587140.100518:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788587140.100528:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208210560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.100594:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208210560:12345-0@lo:400:kworker.0 Request processed in 68us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.100603:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788587140.100626:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210176 00000100:00100000:3.0:1788587140.100630:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210176 00000100:00100000:3.0:1788587140.100663:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210304 00000100:00100000:3.0:1788587140.100667:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210304 00000100:00100000:3.0:1788587140.100679:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210432 00000100:00100000:3.0:1788587140.100681:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210432 00000100:00100000:3.0:1788587140.100695:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788587140.100701:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208210176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.100880:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208210176:12345-0@lo:400:kworker.0 Request processed in 178us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.100887:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788587140.100901:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788587140.100907:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208210304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.100935:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208210304:12345-0@lo:400:kworker.0 Request processed in 29us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.100942:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788587140.100967:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788587140.100973:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208210432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.101282:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208210432:12345-0@lo:400:kworker.0 Request processed in 308us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587140.101289:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788587140.101347:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208210432:0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.101360:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208210560:0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.101693:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210048 00000100:00100000:0.0:1788587140.101698:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210048 00000100:00100000:0.0:1788587140.101742:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788587140.101750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208210048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.101797:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3315:x1875469208210048:12345-0@lo:400:kworker.0 Request processed in 48us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587140.101803:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788587140.101866:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208210304:0@lo:400:kworker.0 00000100:00100000:0.0:1788587140.101881:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208210176:0@lo:400:kworker.0 00000100:00100000:3.0:1788587140.102301:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208210048:0@lo:400:kworker.0 00000100:00100000:2.0:1788587140.102427:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208209920 00000100:00100000:2.0:1788587140.102434:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208209920 00000100:00100000:2.0:1788587140.102473:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587140.102482:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac83053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208209920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587140.102519:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587140.102585:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac83053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208209920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587140.102591:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788587140.102645:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788587140.102652:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bac9071e680, transno 4294967322 00000004:00080000:2.0:1788587140.102662:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788587140.102687:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208209920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587140.103006:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587140.103011:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788587140.103014:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788587140.245511:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788587140.245526:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788587140.247694:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788587140.247740:0:5884:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788587140.612660:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788587140.612685:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208210688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587140.612774:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587140.612939:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210688 00000100:00100000:1.0:1788587140.612949:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210688 00000100:00100000:1.0:1788587140.613012:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788587140.613022:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8309b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208210688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587140.613058:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587140.613128:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8309b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208210688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587140.613134:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788587140.613290:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208210688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788587140.804690:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587141.827410:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587142.171023:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587142.171072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587142.171114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587142.171147:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587142.171199:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587142.171239:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182015360 00000100:00100000:2.0:1788587142.171253:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182015360 00000100:00100000:2.0:1788587142.171322:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182014976 00000100:00100000:2.0:1788587142.171325:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182014976 00000100:00100000:2.0:1788587142.171358:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 186 00000100:00100000:2.0:1788587142.171370:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2360:x1875469182015360:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587142.171475:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2360:x1875469182015360:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 106us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587142.171485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 186 00000100:00100000:2.0:1788587142.171512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 187 00000100:00100000:2.0:1788587142.171522:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2360:x1875469182014976:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587142.171538:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182015104 00000100:00100000:0.0:1788587142.171558:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182015104 00000100:00100000:2.0:1788587142.171576:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2360:x1875469182014976:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 55us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587142.171587:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 187 00000100:00100000:2.0:1788587142.171626:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182015232 00000100:00100000:2.0:1788587142.171632:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182015232 00000100:00100000:0.0:1788587142.171669:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:0.0:1788587142.171682:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469182015104:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587142.171758:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb58c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2360:x1875469182015104:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 76us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587142.171765:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182014848 00000100:00100000:1.0:1788587142.171772:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182014848 00000100:00100000:1.0:1788587142.171817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 309 00000100:00100000:1.0:1788587142.171826:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469182014848:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587142.171884:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2360:x1875469182014848:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 59us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587142.171891:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 309 00000100:00080000:1.0:1788587142.171923:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587142.171927:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587142.171931:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587142.172176:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:2.0:1788587142.172265:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469182015232:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587142.172296:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2360:x1875469182015232:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 37us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587142.172325:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:0.0:1788587142.202508:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 92 00010000:00010000:1.0:1788587142.851258:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587143.875109:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587144.044597:0:12850:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 01:45:42 (1788587142) 00010000:00010000:1.0:1788587144.900665:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587145.220324:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788587145.220349:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208210816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587145.220424:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587145.220528:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210816 00000100:00100000:2.0:1788587145.220545:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210816 00000100:00100000:2.0:1788587145.220614:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788587145.220624:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacaf2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208210816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788587145.220663:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587145.220711:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacaf2b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208210816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587145.220719:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788587145.220741:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587145.220778:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf498a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208210816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587145.232644:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208210944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.232724:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587145.232768:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208211456:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.232794:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587145.232835:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587145.232855:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208211072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.232886:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587145.232918:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208211200:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.232944:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587145.232963:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587145.232989:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208211328:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233017:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587145.233058:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208210944 00000100:00100000:0.0:1788587145.233068:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208210944 00000100:00100000:0.0:1788587145.233116:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788587145.233125:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208210944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233181:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208210944:12345-0@lo:400:kworker.0 Request processed in 57us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587145.233189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788587145.233226:0:12608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211456 00000100:00100000:0.0:1788587145.233230:0:12608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211456 00000100:00100000:0.0:1788587145.233275:0:12608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788587145.233282:0:12608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208211456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233335:0:12608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208211456:12345-0@lo:400:kworker.0 Request processed in 53us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587145.233340:0:12608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788587145.233361:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211072 00000100:00100000:0.0:1788587145.233365:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211072 00000100:00100000:0.0:1788587145.233388:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211200 00000100:00100000:0.0:1788587145.233391:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211200 00000100:00100000:0.0:1788587145.233404:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211328 00000100:00100000:0.0:1788587145.233407:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211328 00000100:00100000:0.0:1788587145.233420:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788587145.233426:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208211072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233458:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208211072:12345-0@lo:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587145.233464:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788587145.233478:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788587145.233492:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208211200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233528:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208211200:12345-0@lo:400:kworker.0 Request processed in 35us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587145.233534:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788587145.233561:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788587145.233567:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208211328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233594:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208211328:12345-0@lo:400:kworker.0 Request processed in 28us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587145.233600:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788587145.233647:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208211072:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233656:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208210944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233664:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208211456:0@lo:400:kworker.0 00000100:00080000:0.0:1788587145.233687:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587145.233691:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587145.233709:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208211328:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.233718:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208211200:0@lo:400:kworker.0 00000100:00100000:0.0:1788587145.732897:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac90c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208211584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587145.732975:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587145.735654:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211584 00000100:00100000:2.0:1788587145.735671:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211584 00000100:00100000:2.0:1788587145.735747:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788587145.735758:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208211584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788587145.735800:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788587145.735894:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208211584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (2918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587145.735901:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788587145.737539:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac90c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208211584:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788587145.923921:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587146.947286:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587147.280385:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587147.280436:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587147.280471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587147.280520:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587147.280594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587147.280613:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182016000 00000100:00100000:0.0:1788587147.280616:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182015616 00000100:00100000:2.0:1788587147.280625:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182016000 00000100:00100000:0.0:1788587147.280625:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182015616 00000100:00100000:3.0:1788587147.280682:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182015744 00000100:00100000:3.0:1788587147.280687:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182015744 00000100:00100000:0.0:1788587147.280762:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 191 00000100:00100000:1.0:1788587147.280828:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182015488 00000100:00100000:1.0:1788587147.280866:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182015488 00000100:00100000:1.0:1788587147.280898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 311 00000100:00100000:1.0:1788587147.280917:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469182015488:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587147.280988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2362:x1875469182015488:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 83us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587147.280996:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 311 00000100:00100000:3.0:1788587147.281510:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182015872 00000100:00100000:3.0:1788587147.281516:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182015872 00000100:00080000:1.0:1788587147.282802:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788587147.282812:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587147.282889:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 192 00000100:00100000:3.0:1788587147.282892:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:3.0:1788587147.282900:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469182015744:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587147.282900:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2362:x1875469182016000:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587147.282977:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2362:x1875469182016000:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 79us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587147.282985:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 192 00000100:00100000:0.0:1788587147.284454:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac90c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2362:x1875469182015616:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587147.284585:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2362:x1875469182015744:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1683us (4145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587147.284596:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:3.0:1788587147.284627:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:3.0:1788587147.284637:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469182015872:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587147.284664:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2362:x1875469182015872:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 31us (4071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587147.284670:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00080000:1.0:1788587147.286151:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587147.287294:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac90c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:2362:x1875469182015616:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 6514us (6763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587147.287310:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 191 00010000:00010000:1.0:1788587147.971363:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587148.547193:0:11708:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788587148.547202:0:11708:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788587148.547821:0:11708:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788587148.547829:0:11708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788587148.995305:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587149.422577:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587149.422684:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182016256 00000100:00100000:1.0:1788587149.422694:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182016256 00000100:00080000:0.0:1788587149.422811:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587149.422874:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:1.0:1788587149.422886:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+18:12334:x1875469182016256:12345-192.168.204.28@tcp:35:umount.0 00000100:00100000:1.0:1788587149.423305:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:12334:x1875469182016256:12345-192.168.204.28@tcp:35:umount.0 Request processed in 421us (738us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788587149.423313:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 66 00000100:00100000:2.0:1788587149.432339:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587149.432605:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182016512 00000100:00100000:3.0:1788587149.432634:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182016512 00000100:00100000:3.0:1788587149.432685:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:3.0:1788587149.432695:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+19:12334:x1875469182016512:12345-192.168.204.28@tcp:35:umount.0 00000100:00100000:3.0:1788587149.433991:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:12334:x1875469182016512:12345-192.168.204.28@tcp:35:umount.0 Request processed in 1291us (1657us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788587149.434014:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 67 00000100:00100000:3.0:1788587149.445102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587149.445176:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182016768 00000100:00100000:1.0:1788587149.445187:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182016768 00000100:00100000:1.0:1788587149.445247:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:1.0:1788587149.445259:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac84661850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+20:12334:x1875469182016768:12345-192.168.204.28@tcp:35:umount.0 00000100:00100000:1.0:1788587149.445593:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac84661850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:12334:x1875469182016768:12345-192.168.204.28@tcp:35:umount.0 Request processed in 335us (502us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788587149.445614:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 68 00000100:00100000:0.0:1788587149.449670:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587149.449754:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182017024 00000100:00100000:1.0:1788587149.449765:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182017024 00000100:00100000:1.0:1788587149.449824:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:1.0:1788587149.449835:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:12334:x1875469182017024:12345-192.168.204.28@tcp:35:umount.0 00000100:00100000:0.0:1788587149.450443:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:12334:x1875469182017024:12345-192.168.204.28@tcp:35:umount.0 Request processed in 607us (786us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788587149.450451:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 69 00000100:00100000:3.0:1788587149.460820:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587149.460896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587149.460931:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587149.461777:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587149.461819:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182017536 00000100:00100000:3.0:1788587149.461828:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182017536 00000100:00100000:3.0:1788587149.461922:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:3.0:1788587149.461932:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2358:x1875469182017536:12345-192.168.204.28@tcp:9:umount.0 00000020:00000080:3.0:1788587149.461962:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88d89 00000100:00080000:3.0:1788587149.461971:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bac92c38000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587149.462010:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788587149.462407:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182017152 00000100:00100000:2.0:1788587149.462413:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182017152 00000100:00100000:2.0:1788587149.462464:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182017408 00000100:00100000:2.0:1788587149.462468:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182017408 00000100:00100000:2.0:1788587149.462484:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182017280 00000100:00100000:2.0:1788587149.462486:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182017280 00000100:00100000:2.0:1788587149.462504:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788587149.462511:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+15:2359:x1875469182017152:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587149.462523:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587149.462671:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf52a600/0xc1a730b05ab88ab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2678 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.462692:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587149.462767:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+14:2359:x1875469182017152:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 256us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587149.462775:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788587149.462795:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788587149.462801:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+13:2359:x1875469182017408:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587149.462810:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587149.462819:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf52ac00/0xc1a730b05ab88cc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2743 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.462828:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587149.462894:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:2359:x1875469182017408:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 93us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587149.462901:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788587149.462915:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1788587149.462921:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:2359:x1875469182017280:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587149.462929:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587149.462940:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4400/0xc1a730b05ab88a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2640 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.462948:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587149.462966:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2359:x1875469182017280:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 45us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587149.462972:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00080000:2.0:1788587149.464041:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788587149.464065:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587149.464921:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+2:2358:x1875469182017536:12345-192.168.204.28@tcp:9:umount.0 Request processed in 2975us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587149.464933:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 72 00000100:00100000:3.0:1788587149.481347:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587149.482128:0:12608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182017920 00000100:00100000:0.0:1788587149.482139:0:12608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182017920 00000100:00100000:0.0:1788587149.482286:0:12608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 73 00000100:00100000:0.0:1788587149.482298:0:12608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+7:2358:x1875469182017920:12345-192.168.204.28@tcp:9:umount.0 00000020:00000080:0.0:1788587149.482332:0:12608:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88fea 00000020:00010000:0.0:1788587149.482340:0:12608:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bacbbc35800: total 0 00000100:00080000:0.0:1788587149.482345:0:12608:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc32800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587149.482516:0:12608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788587149.482824:0:12608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+5:2358:x1875469182017920:12345-192.168.204.28@tcp:9:umount.0 Request processed in 526us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587149.482834:0:12608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 73 00000020:00010000:1.0:1788587149.487580:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bacbbc35800: total 0 00010000:00010000:0.0:1788587149.487736:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bacbbc35800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788587149.487811:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061e1129c/0xc1a730b05ab89a2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ae6 expref: 4 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587149.487904:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be6742e9/0xc1a730b05ab8938d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2918 expref: 3 pid: 10779 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587149.487921:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bacbbc35800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788587149.487933:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587149.487935:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587149.487937:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587149.488014:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587149.505390:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587149.505683:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182018944 00000100:00100000:0.0:1788587149.505695:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182018944 00000100:00100000:0.0:1788587149.505768:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 240 00000100:00100000:0.0:1788587149.505780:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+22:2358:x1875469182018944:12345-192.168.204.28@tcp:39:umount.0 00000020:00000080:0.0:1788587149.505818:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88a25 00000020:00010000:0.0:1788587149.505835:0:5851:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bacbf71b800: total 0 00000100:00080000:0.0:1788587149.505879:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8bacbf719000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587149.505917:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788587149.506290:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8+21:2358:x1875469182018944:12345-192.168.204.28@tcp:39:umount.0 Request processed in 511us (922us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788587149.506299:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 240 00000020:00010000:2.0:1788587149.506868:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bacbf71b800: total 0 00010000:00010000:2.0:1788587149.506873:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587149.506926:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bacbf71b800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788587149.506960:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:2.0:1788587149.506965:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587149.506976:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4000/0xc1a730b05ab893ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2934 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507017:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8baca1025500) 00010000:00010000:2.0:1788587149.507021:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587149.507027:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52be00/0xc1a730b05ab88d0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2758 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507045:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587149.507048:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788587149.507051:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89378 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2911 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507063:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587149.507065:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587149.507069:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a98e00/0xc1a730b05ab899ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ad1 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507080:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587149.507083:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788587149.507086:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89a16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2adf expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507097:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587149.507099:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587149.507102:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8934e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2903 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507114:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8baca1025d00) 00010000:00010000:2.0:1788587149.507117:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587149.507128:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52b000/0xc1a730b05ab88cef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2751 expref: 14 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507143:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587149.507145:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587149.507148:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab896ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a0d expref: 13 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507159:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587149.507161:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788587149.507164:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050a00/0xc1a730b05ab8904c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c283f expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507175:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8baca1025900) 00010000:00010000:2.0:1788587149.507177:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788587149.507181:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf52a800/0xc1a730b05ab8940b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c293b expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507194:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8baca0968700) 00010000:00010000:2.0:1788587149.507196:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587149.507199:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8926e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c28cb expref: 10 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507212:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587149.507215:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788587149.507218:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab88d5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c276d expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507233:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8baca1025700) 00010000:00010000:2.0:1788587149.507241:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587149.507245:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbfab4800/0xc1a730b05ab8990c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2a99 expref: 8 pid: 7662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587149.507258:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bacbf71b800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788587149.507464:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587149.507466:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587149.507468:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587150.021709:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587150.339174:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208211712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587150.339253:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587150.339359:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211712 00000100:00100000:0.0:1788587150.339367:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211712 00000100:00100000:0.0:1788587150.339432:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788587150.339454:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208211712:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788587150.339473:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788587150.339797:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587150.339878:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208211712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 426us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.339885:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788587150.339976:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208211712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587150.341823:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208212224:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.341932:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.341983:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587150.341991:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208211840:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.342020:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.342041:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208212352:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.342083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.342139:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212224 00000100:00100000:3.0:1788587150.342148:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212224 00000100:00100000:3.0:1788587150.342210:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788587150.342220:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208212224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.342270:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208212224:12345-0@lo:400:kworker.0 Request processed in 52us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.342277:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788587150.342299:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211840 00000100:00100000:3.0:1788587150.342303:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211840 00000100:00100000:3.0:1788587150.342327:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788587150.342333:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208211840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.342941:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208211840:12345-0@lo:400:kworker.0 Request processed in 605us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.342949:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788587150.342986:0:10779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212352 00000100:00100000:3.0:1788587150.342991:0:10779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212352 00000100:00100000:3.0:1788587150.343022:0:10779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587150.343029:0:10779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208212352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587150.343526:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208211968:0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.343634:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208212096:0@lo:400:kworker.0 00000100:00100000:0.0:1788587150.348853:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587150.348955:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208211968 00000100:00100000:0.0:1788587150.348965:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208211968 00000100:00100000:0.0:1788587150.349014:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788587150.349023:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208211968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587150.349097:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208211968:12345-0@lo:400:kworker.0 Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587150.349104:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788587150.349152:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208211968:0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.353278:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788587150.355348:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788587150.355361:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587150.359035:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212096 00000100:00100000:1.0:1788587150.359056:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212096 00000100:00100000:1.0:1788587150.359164:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788587150.359176:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208212096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587150.359291:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875469208212096:12345-0@lo:400:kworker.0 Request processed in 118us (6021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587150.359299:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1788587150.359327:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587150.359370:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875469208212096:0@lo:400:kworker.0 00000100:00100000:2.0:1788587150.368191:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208211840:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.371358:0:10779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208212352:12345-0@lo:400:kworker.0 Request processed in 28318us (29263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.371375:0:10779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788587150.371456:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208212352:0@lo:400:kworker.0 00000100:00100000:3.0:1788587150.371477:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208212224:0@lo:400:kworker.0 00000001:00100000:3.0:1788587150.420781:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000001:00080000:3.0:1788587150.420800:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788587150.420823:0:5873:0:(genops.c:885:class_export_put()) final put ffff8bacbf71b800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:3.0:1788587150.420964:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf71b800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 for lustre-MDT0000 00000020:00000080:3.0:1788587150.421033:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbf719000 for lustre-MDT0000 00000001:00100000:1.0:1788587150.438573:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:1.0:1788587150.438586:0:6730:0:(genops.c:885:class_export_put()) final put ffff8bacbbc35800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:3.0:1788587150.438670:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc35800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 for lustre-OST0000 00000020:00000080:3.0:1788587150.439004:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbbc32800 for lustre-OST0000 00000100:00100000:1.0:1788587150.851095:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788587150.851125:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208212480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587150.851219:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587150.851446:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212480 00000100:00100000:3.0:1788587150.851464:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212480 00000100:00100000:3.0:1788587150.851524:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788587150.851536:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208212480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587150.851575:0:6710:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587150.851640:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208212480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587150.851647:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788587150.851887:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208212480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788587151.047541:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587151.747776:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587151.747827:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587151.747900:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587151.748013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182019072 00000100:00100000:3.0:1788587151.748025:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182019072 00000100:00100000:3.0:1788587151.748092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182019328 00000100:00100000:3.0:1788587151.748095:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182019328 00000100:00100000:3.0:1788587151.748110:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182019200 00000100:00100000:3.0:1788587151.748112:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182019200 00000100:00100000:3.0:1788587151.748130:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1788587151.748139:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+12:2360:x1875469182019072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587151.748156:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587151.748182:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d4800/0xc1a730b05ab88af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c268d expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587151.748201:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587151.748257:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+11:2360:x1875469182019072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 119us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587151.748263:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:3.0:1788587151.748295:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1788587151.748302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88342850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+10:2360:x1875469182019328:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587151.748311:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587151.748320:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4600/0xc1a730b05ab88cbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c273c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587151.748330:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587151.748349:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88342850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+9:2360:x1875469182019328:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 48us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587151.748356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:3.0:1788587151.748397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:3.0:1788587151.748403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+8:2360:x1875469182019200:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587151.748424:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587151.748433:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5000/0xc1a730b05ab88afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c26b7 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587151.748443:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587151.748472:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40a7953b-abbc-46ff-aa91-a0ba19d02562+7:2360:x1875469182019200:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 69us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587151.748484:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1788587151.754093:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587151.754338:0:7662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182019584 00000100:00100000:2.0:1788587151.754353:0:7662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182019584 00000100:00100000:2.0:1788587151.754459:0:7662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 241 00000100:00100000:2.0:1788587151.754474:0:7662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+6:2358:x1875469182019584:12345-192.168.204.28@tcp:39:umount.0 00000020:00000080:2.0:1788587151.754670:0:7662:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88b0c 00000020:00010000:2.0:1788587151.754685:0:7662:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bab81225800: total 0 00000100:00080000:2.0:1788587151.754692:0:7662:0:(import.c:65:import_set_state_nolock()) ffff8bab81222000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587151.754732:0:7662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:0.0:1788587151.754930:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bab81225800: total 0 00010000:00010000:0.0:1788587151.755003:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bab81225800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788587151.755053:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968400) 00010000:00010000:0.0:1788587151.755058:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587151.755076:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89a39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2aed expref: 5 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587151.755110:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bab81225800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788587151.755122:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587151.755146:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587151.755148:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587151.757907:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788587151.761270:0:7662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab703820-03cd-48f7-bca8-7e3164455d6c+3:2358:x1875469182019584:12345-192.168.204.28@tcp:39:umount.0 Request processed in 6791us (7178us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788587151.761285:0:7662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 241 00000100:00100000:3.0:1788587151.783457:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587151.783552:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182019840 00000100:00100000:1.0:1788587151.783567:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182019840 00000100:00100000:1.0:1788587151.783648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 313 00000100:00100000:1.0:1788587151.783667:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+7:2358:x1875469182019840:12345-192.168.204.28@tcp:251:umount.0 00000020:00000080:1.0:1788587151.783726:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88a02 00000020:00010000:1.0:1788587151.783735:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bacbf55b800: total 0 00000100:00080000:1.0:1788587151.783741:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8bacbf559800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788587151.783833:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40a7953b-abbc-46ff-aa91-a0ba19d02562+3:2358:x1875469182019840:12345-192.168.204.28@tcp:251:umount.0 Request processed in 168us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587151.783871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 313 00000020:00010000:2.0:1788587151.784131:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bacbf55b800: total 0 00010000:00010000:2.0:1788587151.784137:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587151.784188:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bacbf55b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788587151.784228:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a99e00/0xc1a730b05ab88ab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c267f expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587151.784244:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bacbf55b800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788587151.784270:0:5837:0:(genops.c:885:class_export_put()) final put ffff8bacbf55b800/40a7953b-abbc-46ff-aa91-a0ba19d02562 00010000:00010000:2.0:1788587151.784290:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587151.784292:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587151.784294:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788587151.784382:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf55b800/40a7953b-abbc-46ff-aa91-a0ba19d02562 for MGS 00000020:00000080:3.0:1788587151.784442:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbf559800 for MGS 00010000:00010000:0.0:1788587152.075028:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587152.976530:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:1.0:1788587152.976539:0:7665:0:(genops.c:885:class_export_put()) final put ffff8bac92c3e800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 00000020:00000080:1.0:1788587152.976568:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac92c3e800/4d07a6e6-50a4-4ba9-a0cf-e38d60b757e8 for lustre-OST0001 00000020:00000080:1.0:1788587152.976623:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bac92c38000 for lustre-OST0001 00010000:00010000:1.0:1788587153.094640:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788587153.920260:0:13048:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788587153.953342:0:13048:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788587153.953402:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587153.953418:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587153.953426:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587153.953945:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587153.953968:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788587153.953973:0:13048:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788587153.953995:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587153.953999:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788587153.954005:0:13048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788587153.954028:0:13048:0:(import.c:65:import_set_state_nolock()) ffff8bacaf3ea000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788587153.954056:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208212608:0@lo:39:umount.0 00000100:00100000:2.0:1788587153.954131:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587153.954275:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587153.954283:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.954291:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5a00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587153.954295:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.954305:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587153.954312:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587153.954318:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587153.954321:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788587153.954323:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788587153.954348:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.954354:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587153.954384:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.954391:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5a00/0xc1a730b05ab88a87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a8e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.954402:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587153.954409:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587153.954411:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587153.954418:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587153.954426:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208212736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587153.954826:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587153.954968:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212736 00000100:00100000:2.0:1788587153.954975:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212736 00000100:00100000:2.0:1788587153.955019:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587153.955028:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3314:x1875469208212736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587153.955053:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587153.955067:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf52b800/0xc1a730b05ab88a8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88a87 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587153.955080:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587153.955112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3314:x1875469208212736:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587153.955118:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587153.955272:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208212736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587153.956030:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212608 00000100:00100000:1.0:1788587153.956039:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212608 00000100:00100000:1.0:1788587153.956088:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788587153.956097:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875469208212608:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788587153.956125:0:5850:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88811 00000100:00080000:1.0:1788587153.956135:0:5850:0:(import.c:65:import_set_state_nolock()) ffff8bacb44de000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788587153.956923:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1875469208212608:12345-0@lo:39:umount.0 Request processed in 823us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587153.956950:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788587153.956961:0:5850:0:(genops.c:885:class_export_put()) final put ffff8bacb44dc000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788587153.956989:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788587153.956998:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacb44dc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788587153.957041:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacb44de000 for lustre-MDT0000 00000100:00080000:2.0:1788587153.958414:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacaf3ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788587153.958650:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208212608:0@lo:39:umount.0 00000100:00080000:0.0:1788587153.958702:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587153.958706:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788587153.958710:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788587153.964322:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.964342:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.964350:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.964357:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.964428:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587153.964436:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.964443:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.964461:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.964467:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965266:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587153.965275:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965330:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4a00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587153.965335:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965343:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587153.965349:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587153.965355:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587153.965357:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788587153.965405:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965411:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587153.965433:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965449:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c4a00/0xc1a730b05ab88a95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965463:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587153.965467:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965472:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac80031400 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587153.965475:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965481:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587153.965487:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587153.965491:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587153.965493:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788587153.965505:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965510:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587153.965516:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.965523:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587153.965524:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587153.965527:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587153.965735:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208212864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587153.965807:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587153.965890:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587153.965904:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208212992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587153.965927:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587153.965969:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212864 00000100:00100000:3.0:1788587153.965976:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212864 00000100:00100000:3.0:1788587153.966018:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208212992 00000100:00100000:3.0:1788587153.966021:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208212992 00000100:00100000:3.0:1788587153.966044:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587153.966053:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+19:3312:x1875469208212864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587153.966066:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587153.966082:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a98a00/0xc1a730b05ab88a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88a95 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.966094:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587153.966125:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+18:3312:x1875469208212864:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587153.966132:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587153.966139:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208212864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587153.966147:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587153.966152:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+17:3312:x1875469208212992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587153.966159:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587153.966167:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac80030000/0xc1a730b05ab889c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab889bc expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.966179:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587153.966209:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3312:x1875469208212992:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587153.966215:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587153.966235:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208212992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788587153.966425:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587153.966433:0:13048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac80031400/0xc1a730b05ab889bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab889c3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587153.966451:0:13048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788587153.966458:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.966466:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.966472:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.966479:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.966527:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587153.966534:0:13048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.966541:0:13048:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.966548:0:13048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587153.966554:0:13048:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.966590:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587153.966595:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.966601:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587153.966605:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587153.966606:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587153.966612:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587153.966619:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587153.966624:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788587153.966627:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788587153.966629:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788587153.966646:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.966653:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788587153.966708:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208213120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587153.966742:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587153.966884:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208213120 00000100:00100000:3.0:1788587153.966890:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208213120 00000100:00100000:3.0:1788587153.966927:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788587153.966934:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+16:3314:x1875469208213120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587153.966943:0:8474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587153.966953:0:8474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c4000/0xc1a730b05ab88cb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88cb0 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.966962:0:8474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788587153.967025:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.967033:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5200/0xc1a730b05ab88cb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88cb7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.967042:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587153.967043:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587153.967045:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587153.967097:0:13048:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1788587153.967102:0:13048:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788587153.967105:0:13048:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788587153.967135:0:13048:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788587153.967138:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788587153.967143:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587153.967149:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788587153.967154:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8bacbf519800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587153.967159:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8bacbf55a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587153.967167:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8bab81225800 ab703820-03cd-48f7-bca8-7e3164455d6c 192.168.204.28@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587153.967171:0:13048:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8bac91273380) has exports, disconnecting them 00000020:00080000:1.0:1788587153.967175:0:13048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8bacbf519800), last request at 1788587150 00000020:00000080:1.0:1788587153.967182:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88984 00000100:00080000:1.0:1788587153.967197:0:13048:0:(import.c:65:import_set_state_nolock()) ffff8bacbf51a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788587153.967241:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bacbf519800): rc 0 00000020:00000080:1.0:1788587153.967244:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbf519800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788587153.967255:0:13048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8bacbf55a800), last request at 1788587150 00000020:00000080:1.0:1788587153.967258:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab888b9 00000100:00080000:1.0:1788587153.967263:0:13048:0:(import.c:65:import_set_state_nolock()) ffff8bacbf55e800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788587153.967269:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bacbf55a800): rc 0 00000020:00000080:1.0:1788587153.967271:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbf55a800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788587153.967277:0:13048:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0e2031e7ae0 00000100:00080000:1.0:1788587153.967309:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788587153.967312:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788587153.967325:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587153.967392:0:13048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788587153.967410:0:13048:0:(import.c:65:import_set_state_nolock()) ffff8bac903c1800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788587153.967430:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788587153.967432:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788587153.967440:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788587153.967494:0:13048:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788587153.967504:0:13048:0:(import.c:65:import_set_state_nolock()) ffff8bab81224800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788587153.967530:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8bac91273380) has no exports 00010000:00010000:0.0:1788587153.967833:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587153.968194:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:3314:x1875469208213120:12345-0@lo:103:ldlm_bl.0 Request processed in 1257us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587153.968203:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:3.0:1788587153.968230:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf519800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587153.968278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf55a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788587153.968315:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbf51a000 for lustre-MDT0000 00000020:00000080:3.0:1788587153.968320:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbf55e800 for lustre-MDT0000 00000100:00100000:3.0:1788587153.968363:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208213248:0@lo:9:umount.0 00000100:00100000:3.0:1788587153.968423:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587153.968447:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208213376:0@lo:9:umount.0 00000100:00100000:3.0:1788587153.968467:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788587153.968539:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587153.968547:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.968556:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587153.968559:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.968569:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587153.968588:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587153.968593:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788587153.968595:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788587153.968597:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788587153.968623:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.968628:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587153.968645:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.968651:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c4200/0xc1a730b05ab88770 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88777 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587153.968663:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587153.968665:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587153.968667:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587153.968671:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587153.968674:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587153.968690:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208213248 00000100:00100000:3.0:1788587153.968696:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208213248 00000100:00100000:3.0:1788587153.968736:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208213376 00000100:00100000:3.0:1788587153.968739:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208213376 00000100:00100000:3.0:1788587153.968760:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587153.968768:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875469208213248:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788587153.968789:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88906 00000100:00080000:3.0:1788587153.968796:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bacbf51f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587153.968819:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1788587153.969184:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3311:x1875469208213248:12345-0@lo:9:umount.0 Request processed in 415us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587153.969191:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788587153.969206:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788587153.969213:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875469208213376:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788587153.969225:0:6707:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab889ed 00000100:00080000:3.0:1788587153.969231:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc36000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788587153.969249:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788587153.969451:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3311:x1875469208213376:12345-0@lo:9:umount.0 Request processed in 239us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587153.969458:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788587153.969478:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788587153.969482:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587153.969517:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bac903c1800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788587153.969528:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788587153.969530:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587153.969534:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208213248:0@lo:9:umount.0 00000100:00080000:3.0:1788587153.969545:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81224800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788587153.969554:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788587153.969555:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788587153.969558:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208213376:0@lo:9:umount.0 00010000:00010000:3.0:1788587153.969591:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587153.970218:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208213120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587153.970237:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788587153.970399:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587153.970452:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208213504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587153.970496:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587153.970598:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208213504 00000100:00100000:0.0:1788587153.970604:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208213504 00000100:00100000:0.0:1788587153.970688:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788587153.970699:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+15:3314:x1875469208213504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587153.970713:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587153.970733:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050000/0xc1a730b05ab88777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88770 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587153.970752:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587153.970826:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf98f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3314:x1875469208213504:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587153.970833:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587153.971411:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3314:1875469208213504:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788587153.981068:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8bac91273380) has no exports 00000020:00000080:1.0:1788587154.021663:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab887cb 00000020:00000080:1.0:1788587154.021679:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bac87fe8800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788587154.021710:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788587154.021784:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac87fe8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788587154.021815:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587154.021827:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788587154.021832:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8bac88353380) has no exports 00000020:00000080:2.0:1788587154.022298:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab887c4 00000020:00000080:2.0:1788587154.022304:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbc7d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788587154.022361:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587154.022378:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788587154.022381:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbc7b000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788587154.022418:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc7b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788587154.022426:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788587154.022950:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc7d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788587154.115178:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587155.139073:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587155.459162:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208213632:0@lo:400:kworker.0 00000100:00100000:3.0:1788587155.459186:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208213888:0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.464892:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587155.464956:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208213760:0@lo:400:kworker.0 00000100:00100000:2.0:1788587155.465006:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587155.465684:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208213760 00000100:00100000:3.0:1788587155.465699:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208213760 00000100:00100000:3.0:1788587155.465751:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788587155.465759:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875469208213760:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788587155.465819:0:5852:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788587155.465897:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875469208213760:12345-0@lo:400:kworker.0 Request processed in 137us (889us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788587155.465905:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1788587155.466044:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587155.466051:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8bacbf738800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788587155.466055:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788587155.466380:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208213632 00000100:00100000:2.0:1788587155.466385:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208213632 00000100:00100000:2.0:1788587155.466444:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788587155.466454:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3312:x1875469208213632:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788587155.483612:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8bacbf738800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587155.483629:0:3313:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 242 00000100:00080000:3.0:1788587155.483639:0:3313:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bacbf738800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1788587155.483683:0:3313:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab81f8e300 x1875469208214016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587155.483724:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208213760:0@lo:400:kworker.0 00000100:00100000:1.0:1788587155.483811:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875469208214016:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788587155.483924:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587155.483992:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208214016 00000100:00100000:1.0:1788587155.484000:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208214016 00000100:00100000:1.0:1788587155.484041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788587155.484048:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875469208214016:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788587155.484065:0:5850:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788587155.488053:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587155.488087:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85a94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3+14:3312:x1875469208213632:12345-0@lo:400:kworker.0 Request processed in 21632us (23199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587155.488102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788587155.488188:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3312:1875469208213632:0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.488205:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208213888 00000100:00100000:0.0:1788587155.488213:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208213888 00000100:00100000:0.0:1788587155.488253:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788587155.488261:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1875469208213888:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788587155.488270:0:5852:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788587155.488332:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1875469208213888:12345-0@lo:400:kworker.0 Request processed in 70us (286us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587155.488352:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788587155.488676:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788587155.488682:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc31000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788587155.488686:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788587155.488691:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc31000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587155.488695:0:3314:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 266 00000100:00080000:3.0:1788587155.488709:0:3314:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bacbbc31000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1788587155.488742:0:3314:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab81f8ca80 x1875469208214144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587155.488776:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208213888:0@lo:400:kworker.0 00000100:00100000:0.0:1788587155.489716:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208214144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788587155.489785:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587155.490734:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208214144 00000100:00100000:3.0:1788587155.490748:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208214144 00000100:00100000:3.0:1788587155.490799:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788587155.490807:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875469208214144:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788587155.490827:0:5851:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788587155.490914:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875469208214144:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 106us (1128us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587155.490922:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788587155.490969:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc31000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587155.490974:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788587155.490978:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208214144:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788587155.510318:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875469208214016:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 26260us (26385us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788587155.510332:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788587155.513873:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbf738800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587155.513888:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788587155.513893:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875469208214016:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:2.0:1788587155.543413:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788587155.543422:0:6730:0:(genops.c:885:class_export_put()) final put ffff8bacbf519000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788587155.544021:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf519000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788587155.544067:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbf51f800 for lustre-OST0000 00000001:00100000:3.0:1788587155.570894:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab703820-03cd-48f7-bca8-7e3164455d6c 00000001:00080000:3.0:1788587155.570911:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788587155.570917:0:5873:0:(genops.c:885:class_export_put()) final put ffff8bab81225800/ab703820-03cd-48f7-bca8-7e3164455d6c 00000020:00000080:2.0:1788587155.571049:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bab81225800/ab703820-03cd-48f7-bca8-7e3164455d6c for lustre-MDT0000 00000020:00000080:2.0:1788587155.571107:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bab81222000 for lustre-MDT0000 00000020:01000000:2.0:1788587156.035050:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bab8326c960 - data ffff8bacbfccd510/ffff8bacbbafec00 00000020:01000000:2.0:1788587156.035215:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bac88fef720 - data ffff8bac9e6a70d8/ffff8bacb594b800 00000001:00000004:2.0:1788587156.041869:0:13048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788587156.136643:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587156.136663:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788587156.136690:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587156.136694:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788587156.137321:0:7143:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788587156.137336:0:7143:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788587156.137348:0:7143:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788587156.138412:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587156.138418:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788587156.138436:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587156.138438:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788587156.138683:0:7898:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788587156.138687:0:7898:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788587156.138696:0:7898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788587156.222550:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88793 00000020:00000080:2.0:1788587156.222563:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbcd2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788587156.225096:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbcd2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587156.227113:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab887a8 00000020:00000080:2.0:1788587156.227126:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbcd6800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587156.227139:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788587156.227145:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587156.227163:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587156.227168:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8bac91274d40) has no exports 00000004:01000000:2.0:1788587156.227343:0:13048:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788587156.227353:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab889e6 00000020:00000080:2.0:1788587156.227357:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bab81224000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587156.227361:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788587156.227365:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587156.227371:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788587156.227373:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8bab81218000) has no exports 00000020:00000080:2.0:1788587156.227379:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab889df 00000020:00000080:2.0:1788587156.227382:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bab81222800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788587156.227713:0:13048:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788587156.227718:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788587156.227722:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788587156.227728:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587156.227730:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788587156.227756:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587156.227763:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587156.227768:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab888ff 00000020:00000080:2.0:1788587156.227772:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbf55f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788587156.227787:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788587156.227790:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587156.227794:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788587156.227796:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8bacae3ab380) has no exports 00000020:00000080:2.0:1788587156.227800:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab888f8 00000020:00000080:2.0:1788587156.227802:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bac903c2000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788587156.228139:0:13048:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788587156.228142:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788587156.228145:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788587156.228148:0:13048:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788587156.228150:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788587156.228177:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587156.228182:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587156.228205:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587156.228208:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587156.228232:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab887af 00000020:00000080:2.0:1788587156.228236:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbcd4000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788587156.228239:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788587156.228242:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587156.228245:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587156.228247:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8bac91270000) has no exports 00000020:00000080:2.0:1788587156.228264:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587156.228267:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788587156.228270:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab887b6 00000020:00000080:2.0:1788587156.228272:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbcd0800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788587156.228279:0:13048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bac83941800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788587156.228282:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bac83941800 3 00000020:01000004:2.0:1788587156.228285:0:13048:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bac83941800 from lustre-MDT0000 00000020:00000080:2.0:1788587156.228302:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587156.228304:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788587156.228307:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbcd4800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788587156.228309:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbcd4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788587156.228316:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:1.0:1788587156.228521:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbcd6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788587156.228527:0:37:0:(genops.c:885:class_export_put()) final put ffff8bacb44d8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587156.228529:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacb44d8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788587156.228538:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587156.228664:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bab81224000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788587156.228669:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bab81222800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788587156.228674:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bab81224800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788587156.228679:0:37:0:(genops.c:885:class_export_put()) final put ffff8baca4f31000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587156.228681:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8baca4f31000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788587156.228684:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587156.228707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf55f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788587156.228712:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac903c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788587156.228717:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bac903c1800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788587156.228721:0:37:0:(genops.c:885:class_export_put()) final put ffff8bacbbc7f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587156.228723:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc7f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788587156.228728:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788587156.228781:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbcd4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788587156.228795:0:37:0:(genops.c:885:class_export_put()) final put ffff8bacbbcd6000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788587156.228797:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbcd6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788587156.228800:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788587156.228942:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbcd0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788587156.234691:0:13048:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788587156.234703:0:13048:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788587156.234711:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788587156.234716:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587156.234721:0:13048:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788587156.234730:0:13048:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8bac9078a000 edb4810b-25f5-40e7-b9fe-d44ac5bbddf3 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788587156.234737:0:13048:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8bac88354d40) has exports, disconnecting them 00000020:00080000:2.0:1788587156.234741:0:13048:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8bac9078a000), last request at 1788586898 00000020:00000080:2.0:1788587156.234757:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88754 00000020:00010000:2.0:1788587156.234764:0:13048:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8bac9078a000: total 0 00000100:00080000:2.0:1788587156.234769:0:13048:0:(import.c:65:import_set_state_nolock()) ffff8bac9078e000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788587156.234803:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bac9078a000): rc 0 00000020:00080000:2.0:1788587156.234808:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8bac88354d40) has no exports 00000100:00100000:2.0:1788587156.234903:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8baca785e200:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788587156.235122:0:5845:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8baca785fe00:5845] 2 exiting: rc = 0 00000020:00010000:0.0:1788587156.235233:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8bac9078a000: total 0 00010000:00010000:0.0:1788587156.235270:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8bac9078a000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788587156.235300:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c5400/0xc1a730b05ab88a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88a6b expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235374:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab88a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88a4f expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235386:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d4c00/0xc1a730b05ab88a64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88a5d expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235397:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab88a80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88a79 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235409:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a98400/0xc1a730b05ab88c9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88c94 expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235420:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf52a000/0xc1a730b05ab88aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88aa3 expref: 4 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235434:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf52ae00/0xc1a730b05ab88ca9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88ca2 expref: 3 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235449:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bac829c5800/0xc1a730b05ab8886c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc1a730b05ab88865 expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587156.235459:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8bac9078a000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788587156.235472:0:5838:0:(genops.c:885:class_export_put()) final put ffff8bac9078a000/edb4810b-25f5-40e7-b9fe-d44ac5bbddf3 00010000:00010000:0.0:1788587156.235493:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587156.235496:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587156.235498:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587156.235524:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8baca783e800:5844] 1 exiting: rc = 0 00000020:00000080:1.0:1788587156.235759:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac9078a000/edb4810b-25f5-40e7-b9fe-d44ac5bbddf3 for MGS 00000020:00000080:1.0:1788587156.235813:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bac9078e000 for MGS 00000100:00100000:2.0:1788587156.236499:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236509:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236514:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236520:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236527:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236532:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236538:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236543:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236549:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236554:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236560:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236566:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236571:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236576:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236581:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236587:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236593:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236600:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236606:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236620:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236626:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236632:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236638:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236643:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236649:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236655:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236660:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236666:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236671:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236676:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236683:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236688:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236695:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236700:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236705:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236710:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236715:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236721:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236726:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236732:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236737:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236742:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236747:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236752:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236758:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236763:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236768:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236773:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236778:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236783:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236803:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236809:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236815:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236820:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236833:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236838:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236863:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236868:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236882:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236888:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236894:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236901:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236906:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.236912:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788587156.237285:0:13048:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788587156.237289:0:13048:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788587156.238486:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bac86110120 - data ffff8bac9e705438/ffff8bacbc80b800 00000020:01000000:1.0:1788587156.238611:0:13048:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8baca7839d80 - data ffff8bacb97d2870/ffff8bac883aa000 00000020:00000080:1.0:1788587156.239286:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88738 00000020:00000080:1.0:1788587156.239296:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bac88195000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788587156.239314:0:13048:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bac83941800 from MGS, refs=2 00000020:01000004:1.0:1788587156.239318:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bac83941800 2 00000020:01000004:1.0:1788587156.239348:0:13048:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bac83941800 from MGS 00000020:00000080:1.0:1788587156.239377:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587156.239383:0:13048:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788587156.239386:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bac88196000/MGS 00000020:00000080:1.0:1788587156.239389:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac88196000/MGS for MGS 00000020:01000000:1.0:1788587156.239395:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788587156.239449:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788587156.239453:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587156.239459:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587156.239465:0:13048:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8bacbbcd7800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587156.239471:0:13048:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8bac90283380) has exports, disconnecting them 00000020:00080000:1.0:1788587156.239475:0:13048:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8bacbbcd7800), last request at 1788586899 00000020:00000080:1.0:1788587156.239479:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88803 00000020:00080000:1.0:1788587156.239490:0:13048:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bacbbcd7800): rc 0 00000020:00000080:1.0:1788587156.239494:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bacbbcd7800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788587156.240421:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac88195000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788587156.240432:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbcd7800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788587156.242128:0:13048:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788587156.242137:0:13048:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587156.242142:0:13048:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587156.242157:0:13048:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788587156.242353:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587156.242361:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788587156.242367:0:13048:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bac83941800 1 00000020:00000080:0.0:1788587156.242372:0:13048:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab8872a 00000020:00000080:0.0:1788587156.242380:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bac88191800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788587156.242385:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788587156.242391:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587156.242395:0:13048:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587156.242398:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8bac902819c0) has no exports 00000020:00000080:2.0:1788587156.246989:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacaf3ea000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788587156.247006:0:38:0:(genops.c:885:class_export_put()) final put ffff8bacaf3e8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788587156.247010:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacaf3e8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788587156.247028:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788587156.247111:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac88191800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788587156.327561:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587156.327579:0:13048:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788587156.327587:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bac9073c000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788587156.327592:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac9073c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788587156.327601:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788587156.327776:0:13048:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bac90738800 00000020:01000000:2.0:1788587156.327802:0:13048:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788587156.327806:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587156.327812:0:13048:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788587156.327816:0:13048:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8bac90284d40) has no exports 00000100:00100000:3.0:1788587156.327939:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8bac9ec54000:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1788587156.328019:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8bac83176e00:5852] 2 exiting: rc = 0 00000100:00100000:0.0:1788587156.328289:0:7662:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8bacc18c9000:7662] 3 exiting: rc = 0 00000100:00100000:1.0:1788587156.335253:0:5850:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8bac83177e00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1788587156.336648:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.336657:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.336664:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.336670:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.336675:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.336681:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.336699:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.336704:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338686:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338707:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338715:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338722:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338742:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338751:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338760:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338767:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338775:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338794:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338803:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338811:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338819:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338826:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338839:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.338863:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339001:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339010:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339015:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339020:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339025:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339030:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339035:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.339040:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340301:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340320:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340340:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340347:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340354:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340362:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340369:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340376:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340383:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340405:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340413:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340420:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340428:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340436:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340444:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340451:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340458:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340466:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340475:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340486:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340494:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340502:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340513:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340522:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340530:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340535:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340549:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340554:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340559:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340567:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340572:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.340578:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.349039:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8bac98092c00:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1788587156.349650:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8bac90f05200:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1788587156.350048:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350058:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350064:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350070:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350078:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350124:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350135:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350154:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350163:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350172:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350179:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350188:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350213:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350222:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350239:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350245:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350258:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350264:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350353:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350360:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350367:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350375:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350381:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350388:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350395:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350402:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350408:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350415:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350421:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350429:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350435:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350442:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350448:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350455:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350462:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350470:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350478:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350484:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350492:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350502:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350513:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350524:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350530:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350540:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350547:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350553:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350557:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350570:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350574:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350579:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350584:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350589:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350595:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350600:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350605:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350610:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350614:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350619:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350624:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350630:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350635:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350640:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350645:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.350651:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.351608:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8bac90311600:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788587156.351705:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8bac9808a400:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1788587156.351987:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352000:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352007:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352015:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352021:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352027:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352034:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352040:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352048:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352055:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352064:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352097:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352106:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352114:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352126:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352384:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352390:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352396:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352412:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352419:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352425:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352432:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352439:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352459:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352466:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352472:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352478:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352484:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352490:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352496:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352503:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352509:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352515:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352521:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352527:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352548:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352555:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352561:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352567:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352573:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352579:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352583:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352589:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352595:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352600:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352606:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352612:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352632:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352641:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352646:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352654:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352660:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352666:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352678:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352684:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352690:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352697:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352702:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352709:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352728:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352735:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352742:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352748:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.352756:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.376208:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8bac90311400:5857] 0 exiting: rc = 1 00000100:00100000:1.0:1788587156.376228:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8bac9808a800:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1788587156.376338:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376349:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376356:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376363:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376371:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376378:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376385:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376393:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376400:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376406:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376412:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376419:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376427:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376449:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.376454:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377653:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377668:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377674:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377679:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377684:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377690:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377695:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377700:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377705:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377710:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377715:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377720:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377725:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377730:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377734:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377739:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377744:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377749:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377754:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377759:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377765:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377770:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377774:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377779:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377794:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377800:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377805:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377811:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377816:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377821:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377826:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377830:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377932:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377952:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377958:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377964:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377971:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377978:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377986:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377993:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.377999:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378006:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378013:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378021:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378028:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378037:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378044:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378054:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.378064:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587156.379077:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8bac9808a200:5859] 0 exiting: rc = 1 00000100:00100000:2.0:1788587156.379103:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8bac85be7000:5860] 1 exiting: rc = 0 00000100:00100000:0.0:1788587156.379509:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379517:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379522:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379534:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379540:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379545:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379550:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379555:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379560:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379565:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379571:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379576:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379582:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379586:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379592:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379596:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379607:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379612:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379619:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379640:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379646:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379651:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379656:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379661:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379667:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379671:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379676:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379680:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379685:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379691:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379697:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379701:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379706:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379711:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379717:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379722:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379727:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379731:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379737:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379741:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379746:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379751:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379756:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379761:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379766:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379771:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379777:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379795:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379802:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379807:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379813:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379819:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379824:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379829:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379863:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379881:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379886:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379891:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379895:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379900:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379904:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379909:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379914:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.379919:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.380776:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8bac85a60c00:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1788587156.380962:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8bac90c65400:5861] 0 exiting: rc = 1 00000100:00100000:0.0:1788587156.385588:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385599:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385604:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385609:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385614:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385619:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385624:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385631:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385637:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385649:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385656:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385661:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385666:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385672:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385677:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385683:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385688:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385693:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385699:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385705:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385711:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385716:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385721:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385727:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385752:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385758:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385763:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385768:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385773:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.385778:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386004:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386013:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386017:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386022:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386027:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386032:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386038:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386042:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386050:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386056:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386061:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386066:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386072:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386077:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386735:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386743:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386749:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386754:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386759:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386764:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386770:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386776:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386781:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386800:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386806:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386811:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386817:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386822:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.386828:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.387031:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.387037:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.387042:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.387047:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.387053:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587156.388140:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8bac90c64e00:5863] 0 exiting: rc = 1 00000100:00100000:0.0:1788587156.389470:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8bac90c64200:5864] 1 exiting: rc = 0 00000100:00100000:1.0:1788587156.389708:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8bacb44d2200:5865] 2 exiting: rc = 0 00000100:00100000:0.0:1788587156.393620:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393634:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393642:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393650:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393657:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393665:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393672:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393679:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393686:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393693:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393702:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393711:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393718:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393726:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393753:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393761:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393768:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393779:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393785:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393790:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393800:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393807:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393818:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393824:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393831:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393836:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393860:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393878:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393885:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.393904:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394130:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394137:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394152:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394159:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394166:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394172:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394179:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394184:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394205:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394211:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394217:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394223:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394228:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394234:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394239:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394245:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394250:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394256:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394261:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394267:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394272:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394278:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394283:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394289:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394295:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394301:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394306:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394311:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394316:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394333:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394339:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394346:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394351:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788587156.394356:0:13048:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788587156.407965:0:13048:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587156.407979:0:13048:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788587156.407986:0:13048:0:(genops.c:885:class_export_put()) final put ffff8bac85ba1000/MDS_uuid 00000020:00000080:1.0:1788587156.407991:0:13048:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac85ba1000/MDS_uuid for MDS 00000020:01000000:1.0:1788587156.408000:0:13048:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788587156.408290:0:13048:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788587156.442682:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587157.443695:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788587158.104580:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587158.104926:0:7665:0:(genops.c:885:class_export_put()) final put ffff8bacbbc34000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587158.105928:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc34000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788587158.105979:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbbc36000 for lustre-OST0001 00010000:00010000:1.0:1788587158.468493:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587159.491405:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788587159.646839:0:13202:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788587159.660337:0:13202:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788587159.660392:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.660438:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.660447:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.660454:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.660513:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788587159.660519:0:13202:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788587159.660544:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587159.660549:0:13202:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788587159.660557:0:13202:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788587159.660563:0:13202:0:(import.c:65:import_set_state_nolock()) ffff8bacbf738800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788587159.660568:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587159.660570:0:13202:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788587159.660573:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788587159.661399:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.661411:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.661418:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.661425:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.661636:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587159.661645:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.661653:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a400 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587159.661656:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.661665:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587159.661671:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587159.661677:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587159.661679:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788587159.661681:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788587159.661718:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.661724:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788587159.661788:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208214272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587159.661878:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587159.661972:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.661980:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a400/0xc1a730b05ab88a6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.661995:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587159.661999:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.662016:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52a200 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587159.662018:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.662025:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587159.662030:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587159.662034:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788587159.662036:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788587159.662051:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.662056:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587159.662071:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587159.662079:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587159.662080:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587159.662082:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587159.662093:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587159.662103:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208214400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587159.662129:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587159.662164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208214272 00000100:00100000:0.0:1788587159.662170:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208214272 00000100:00100000:0.0:1788587159.662198:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208214400 00000100:00100000:0.0:1788587159.662200:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208214400 00000100:00100000:0.0:1788587159.662220:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587159.662226:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac86072050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3315:x1875469208214272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788587159.662232:0:5835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587159 with bad export cookie 13954175504425191252 00000100:00100000:1.0:1788587159.663147:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587159.663156:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1875469208214400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788587159.663164:0:5834:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788587159 with bad export cookie 13954175504425191252 00000100:00100000:1.0:1788587159.663237:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1875469208214400:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1106us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788587159.663244:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788587159.663302:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788587159.663308:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8bac9078f800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788587159.663311:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.128@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788587159.664624:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788587159.664640:0:13202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf52a200/0xc1a730b05ab88a79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88a80 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.664668:0:13202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.664677:0:13202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.664685:0:13202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.664692:0:13202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.664717:0:13202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788587159.664723:0:13202:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1788587159.664728:0:13202:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788587159.664758:0:13202:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788587159.664763:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1788587159.664794:0:13049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587159.664801:0:13049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.664808:0:13049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5600 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587159.664811:0:13049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.664838:0:13049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587159.664865:0:13049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587159.664870:0:13049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788587159.664873:0:13049:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788587159.664875:0:13049:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788587159.664948:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587159.665954:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587159.665966:0:13202:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788587159.665971:0:13202:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8bac88350000) has no exports 00000020:00080000:2.0:1788587159.666005:0:13202:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8bac88350000) has no exports 00000020:01000000:2.0:1788587159.667677:0:13202:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bac82ed9de0 - data ffff8bac9e427798/ffff8bacbc80b000 00000020:01000000:2.0:1788587159.667871:0:13202:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bac86f10a80 - data ffff8bacb979eaf8/ffff8bacbf86e000 00000100:00100000:0.0:1788587159.672017:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac86072050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3315:x1875469208214272:12345-0@lo:103:ldlm_bl.0 Request processed in 9783us (10132us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788587159.672033:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788587159.672117:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.128@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788587159.685831:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.128@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788587159.685836:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788587159.685861:0:3313:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bacbf351880 x1875469208214272/t0(0) o103->MGC192.168.204.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587175 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587159.685877:0:3313:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bacbf352680 x1875469208214400/t0(0) o103->MGC192.168.204.128@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788587175 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788587159.685891:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788587159.685894:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788587159.685895:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788587159.685900:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8bac9078f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587159.685905:0:3313:0:(import.c:545:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 220 00000100:00080000:1.0:1788587159.685915:0:3313:0:(import.c:665:import_select_connection()) MGC192.168.204.128@tcp: import ffff8bac9078f800 using connection 192.168.204.128@tcp/0@lo 00000100:00080000:0.0:1788587159.685919:0:3315:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8bac9078f800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:0.0:1788587159.685939:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3315:1875469208214272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788587159.685947:0:3313:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacb5b83100 x1875469208214528/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587159.686337:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3311:1875469208214528:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:1.0:1788587159.686379:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3313:1875469208214400:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1788587159.686392:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875469208214528 offset 0 length 520: 4 00010000:00010000:3.0:1788587159.687086:0:13049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.687100:0:13049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788587159.687270:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788587159.687293:0:13049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.687302:0:13049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5600/0xc1a730b05ab88ca2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc1a730b05ab88ca9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587159.687329:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587159.687332:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587159.687334:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587159.687415:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:0:1875469208214656:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1788587159.703805:0:13202:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788587159.750489:0:13202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88888 00000020:00000080:0.0:1788587159.750500:0:13202:0:(genops.c:885:class_export_put()) final put ffff8bacbf55f000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788587159.750522:0:13202:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bacaf3ef800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788587159.750526:0:13202:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacaf3ef800 2 00000020:01000004:0.0:1788587159.750529:0:13202:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bacaf3ef800 from lustre-OST0000 00000020:00000080:0.0:1788587159.750554:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587159.750564:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788587159.750567:0:13202:0:(genops.c:885:class_export_put()) final put ffff8baca4f37000/lustre-OST0000_UUID 00000020:00000080:0.0:1788587159.750571:0:13202:0:(genops.c:844:class_export_destroy()) destroying export ffff8baca4f37000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788587159.750578:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788587159.750619:0:13202:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788587159.750623:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788587159.750627:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587159.750632:0:13202:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788587159.750639:0:13202:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8bacbf738000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788587159.750645:0:13202:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8bacbf730000) has exports, disconnecting them 00000020:00080000:0.0:1788587159.750650:0:13202:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8bacbf738000), last request at 1788586919 00000020:00000080:0.0:1788587159.750654:0:13202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab888b2 00000020:00080000:0.0:1788587159.750678:0:13202:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bacbf738000): rc 0 00000020:00000080:0.0:1788587159.750684:0:13202:0:(genops.c:885:class_export_put()) final put ffff8bacbf738000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788587159.751130:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf55f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788587159.751146:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf738000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788587159.771629:0:13202:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788587159.771637:0:13202:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788587159.771642:0:13202:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788587159.771651:0:13202:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587159.771944:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbf738800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788587159.771999:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788587159.772010:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788587159.772092:0:13202:0:(genops.c:885:class_export_put()) final put ffff8bacbf71e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788587159.772097:0:13202:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbf71e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788587159.772112:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788587159.772169:0:13202:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacaf3ef800 1 00000020:00000080:0.0:1788587159.772176:0:13202:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88842 00000020:00000080:0.0:1788587159.772183:0:13202:0:(genops.c:885:class_export_put()) final put ffff8bac92c3f800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788587159.772228:0:13202:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788587159.772233:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788587159.772238:0:13202:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788587159.772242:0:13202:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8bac90280000) has no exports 00000020:00000080:3.0:1788587159.774231:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac92c3f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788587159.813674:0:13202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587159.813693:0:13202:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788587159.813700:0:13202:0:(genops.c:885:class_export_put()) final put ffff8bacb44df000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788587159.813720:0:13202:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacb44df000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788587159.813732:0:13202:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788587159.813943:0:13202:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bacaf3ef000 00000020:02000400:2.0:1788587159.814006:0:13202:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788587160.516592:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587160.579049:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) edb4810b-25f5-40e7-b9fe-d44ac5bbddf3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587160.579068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) edb4810b-25f5-40e7-b9fe-d44ac5bbddf3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587160.579072:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788587160.579076:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788587160.579080:0:37:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc31000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587160.579088:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 477 00000100:00080000:0.0:1788587160.579095:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587160.579102:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bacbbc31000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788587160.579146:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbf351880 x1875469208214784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587160.579282:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208214784:0@lo:38:kworker.0 00000400:00000100:2.0:1788587160.579343:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875469208214784 offset 0 length 520: 4 00010000:00010000:2.0:1788587161.543719:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587162.564023:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788587162.918789:0:13352:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788587162.938403:0:13352:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788587162.938516:0:13352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.938531:0:13352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.938538:0:13352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.938546:0:13352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.938572:0:13352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788587162.938578:0:13352:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788587162.938601:0:13352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587162.938611:0:13352:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bacbf351880 x1875469208214784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788587175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587162.938668:0:13352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788587162.938676:0:13352:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788587162.938682:0:13352:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc31000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788587162.938687:0:13352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788587162.938691:0:13352:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bacbf351880 x1875469208214784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788587175 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788587162.938732:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587162.938739:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.938762:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98800 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:1.0:1788587162.938767:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.938776:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587162.938782:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587162.938787:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587162.938790:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788587162.938792:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788587162.938804:0:5837:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bac9078f800 00010000:00010000:1.0:1788587162.938808:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.938815:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab88a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab88a56 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.938827:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587162.938828:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587162.938830:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587162.941875:0:13352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788587162.943416:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208214784:0@lo:38:kworker.0 00000100:00100000:3.0:1788587162.944101:0:13352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788587162.950510:0:13352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.950530:0:13352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.950552:0:13352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.950560:0:13352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.951607:0:13352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587162.951625:0:13352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.951634:0:13352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.951641:0:13352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.951648:0:13352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.953898:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788587162.953915:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.953925:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99c00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:1.0:1788587162.953930:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.954184:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587162.954193:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587162.954209:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587162.954212:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788587162.954227:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bac9078f800 00010000:00010000:1.0:1788587162.954231:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.954238:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99c00/0xc1a730b05ab88a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab88a64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587162.955952:0:13352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788587162.955977:0:13352:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788587162.955986:0:13352:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788587162.956017:0:13352:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788587162.956020:0:13352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788587162.956030:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587162.956036:0:13352:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788587162.956041:0:13352:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8bacbbc28000) has no exports 00000020:00080000:3.0:1788587162.956068:0:13352:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8bacbbc28000) has no exports 00010000:00010000:0.0:1788587162.956353:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587162.956365:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.956376:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf52b400 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587162.956379:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.956389:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587162.956397:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587162.956403:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788587162.956405:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788587162.956407:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788587162.956422:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bac9078f800 00010000:00010000:0.0:1788587162.956427:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.956433:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf52b400/0xc1a730b05ab88c94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab88c9b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587162.956452:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587162.956453:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587162.956456:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788587162.957713:0:13352:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bac82ed9900 - data ffff8bac9e6d5360/ffff8bacbfae1000 00000020:01000000:3.0:1788587162.957944:0:13352:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8bacb4c897e0 - data ffff8bac9e421a20/ffff8bacbf72f000 00010000:00010000:1.0:1788587162.958543:0:13049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788587162.971425:0:13352:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788587162.999341:0:13352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88953 00000020:00000080:1.0:1788587162.999351:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bacbbc37000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788587162.999373:0:13352:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bacbb896000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788587162.999377:0:13352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacbb896000 2 00000020:01000004:1.0:1788587162.999380:0:13352:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8bacbb896000 from lustre-OST0001 00000020:00000080:1.0:1788587162.999408:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587162.999419:0:13352:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788587162.999423:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bac88a10800/lustre-OST0001_UUID 00000020:00000080:1.0:1788587162.999426:0:13352:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac88a10800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788587162.999435:0:13352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788587162.999535:0:13352:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import edb4810b-25f5-40e7-b9fe-d44ac5bbddf3->MGS 00010000:00010000:1.0:1788587162.999556:0:13352:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab8886c expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587162.999585:0:13352:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab8886c expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587162.999591:0:13352:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788587162.999594:0:13352:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788587162.999597:0:13352:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788587162.999612:0:13352:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bac9078f800 00010000:00010000:1.0:1788587162.999615:0:13352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bac829c5000/0xc1a730b05ab88865 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab8886c expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587162.999629:0:13352:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc1a730b05ab88aaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788587162.999635:0:13352:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc1a730b05ab88aaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587162.999640:0:13352:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788587162.999642:0:13352:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788587162.999644:0:13352:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788587162.999652:0:13352:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8bac9078f800 00010000:00010000:1.0:1788587162.999654:0:13352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab88aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc1a730b05ab88aaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788587162.999670:0:13352:0:(import.c:65:import_set_state_nolock()) ffff8bac9078f800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788587162.999675:0:13352:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788587162.999677:0:13352:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788587162.999678:0:13352:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788587162.999682:0:13352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788587162.999693:0:13352:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8bacb5b83100 x1875469208214528/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788587169 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788587162.999723:0:13352:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788587162.999726:0:13352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1788587162.999872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc37000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788587163.001189:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:edb4810b-25f5-40e7-b9fe-d44ac5bbddf3:3311:1875469208214528:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1788587163.001368:0:13352:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788587163.001381:0:13352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88746 00000020:00000080:1.0:1788587163.001389:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bac85ba7000/edb4810b-25f5-40e7-b9fe-d44ac5bbddf3 00000020:01000000:1.0:1788587163.001407:0:13352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.128@tcp (flags='') 00000020:00000080:1.0:1788587163.001416:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587163.001423:0:13352:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.128@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788587163.001427:0:13352:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8bac912719c0) has no exports 00000020:00000080:3.0:1788587163.001484:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac85ba7000/edb4810b-25f5-40e7-b9fe-d44ac5bbddf3 for MGC192.168.204.128@tcp 10000000:01000000:2.0:1788587163.001530:0:5847:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788587163.002832:0:13352:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.128@tcp: client import never connected 00000100:00080000:1.0:1788587163.002838:0:13352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788587163.002865:0:13352:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788587163.002870:0:13352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788587163.002873:0:13352:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788587163.002927:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788587163.002936:0:13352:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.128@tcp (uuid edb4810b-25f5-40e7-b9fe-d44ac5bbddf3) 00000020:01000000:1.0:1788587163.002945:0:13352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788587163.002951:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788587163.002967:0:13352:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788587163.002974:0:13352:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8bacbbc37800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788587163.002980:0:13352:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8bacbbc299c0) has exports, disconnecting them 00000020:00080000:1.0:1788587163.002985:0:13352:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8bacbbc37800), last request at 1788586944 00000020:00000080:1.0:1788587163.002990:0:13352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab8897d 00000020:00080000:1.0:1788587163.003006:0:13352:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8bacbbc37800): rc 0 00000020:00000080:1.0:1788587163.003011:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bacbbc37800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788587163.003229:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bac9078f800 for MGC192.168.204.128@tcp 00000020:00000080:3.0:1788587163.003236:0:36:0:(genops.c:885:class_export_put()) final put ffff8bac9078f000/edb4810b-25f5-40e7-b9fe-d44ac5bbddf3 00000020:00000080:3.0:1788587163.003239:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac9078f000/edb4810b-25f5-40e7-b9fe-d44ac5bbddf3 for MGC192.168.204.128@tcp 00000020:01000000:3.0:1788587163.003246:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.128@tcp (edb4810b-25f5-40e7-b9fe-d44ac5bbddf3) 00000020:00000080:3.0:1788587163.003485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc37800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788587163.005938:0:13352:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788587163.005946:0:13352:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788587163.005951:0:13352:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788587163.005969:0:13352:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788587163.006320:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bacbbc31000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788587163.025391:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788587163.029926:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788587163.030588:0:13049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788587163.030977:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8bac988ac000:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1788587163.031240:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8bac988ac800:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1788587163.031527:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032161:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8bac858e0400:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788587163.032357:0:8474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8bacbf720400:8474] 3 exiting: rc = 0 00000100:00100000:2.0:1788587163.032440:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8bac83baca00:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1788587163.032618:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8bac893cf800:5836] 2 exiting: rc = 0 00000100:00100000:1.0:1788587163.032703:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032710:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032716:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032722:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032727:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032732:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032738:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032826:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032834:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032865:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032873:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032879:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032885:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032891:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032897:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032903:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032908:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032915:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032921:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032927:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032932:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032937:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032942:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.032948:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033173:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033181:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033187:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033192:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033207:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033213:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033218:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033223:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033229:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033234:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033239:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033257:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033262:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033268:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033273:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033277:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033282:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033287:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033292:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033297:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033302:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033306:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033311:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033316:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033320:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033325:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033329:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033334:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033339:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033344:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033350:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033355:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033360:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033365:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033370:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033375:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033381:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033386:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033390:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788587163.033395:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788587163.035348:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788587163.035361:0:13352:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788587163.035367:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bacbbc30800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788587163.035372:0:13352:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbbc30800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788587163.035378:0:13352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788587163.035423:0:13352:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacbb896000 1 00000020:00000080:2.0:1788587163.035504:0:13352:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab88922 00000020:00000080:2.0:1788587163.035511:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bacbb890800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788587163.035556:0:13352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788587163.035561:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788587163.035565:0:13352:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788587163.035579:0:13352:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8bac883519c0) has no exports 00000020:00000080:3.0:1788587163.036238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbb890800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788587163.054720:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587163.054735:0:13352:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788587163.055257:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bacbb896800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788587163.055263:0:13352:0:(genops.c:844:class_export_destroy()) destroying export ffff8bacbb896800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788587163.055275:0:13352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788587163.056034:0:13352:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8bacbb895800 00000020:01000000:3.0:1788587163.056060:0:13352:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788587163.056065:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788587163.056073:0:13352:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788587163.056077:0:13352:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8bacae3acd40) has no exports 00000020:00000080:3.0:1788587163.056626:0:13352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788587163.056637:0:13352:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788587163.056641:0:13352:0:(genops.c:885:class_export_put()) final put ffff8bac92c3f000/OSS_uuid 00000020:00000080:3.0:1788587163.056645:0:13352:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac92c3f000/OSS_uuid for OSS 00000020:01000000:3.0:1788587163.056650:0:13352:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788587163.056758:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8bac8823d800:6707] 1 exiting: rc = 0 00000100:00100000:3.0:1788587163.056885:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8bacb5952e00:6708] 2 exiting: rc = 0 00000100:00100000:3.0:1788587163.056937:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8bacb5952a00:6706] 0 exiting: rc = 1 00000100:00100000:3.0:1788587163.056999:0:10779:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8bacae756600:10779] 3 exiting: rc = 0 00000100:00080000:2.0:1788587163.057090:0:5846:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788587163.057745:0:12608:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8bac92e7f000:12608] 4 exiting: rc = 0 00000100:00100000:3.0:1788587163.058020:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058030:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058038:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058047:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058052:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058058:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058064:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058069:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058075:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058081:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058086:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058092:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058097:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058117:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058122:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058128:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058133:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058139:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058144:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058149:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058154:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058159:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058164:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058170:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058175:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058180:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058186:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058191:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058210:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058215:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058221:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058239:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058244:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058250:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058256:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058261:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058268:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058274:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058280:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058285:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058290:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058295:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058301:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058306:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058312:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058318:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058323:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058328:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058333:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058339:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058345:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058351:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058356:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058361:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058367:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058372:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058377:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058383:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058392:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058398:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058403:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058408:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058414:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.058419:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059342:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8bac87e8c800:6710] 1 exiting: rc = 0 00000100:00100000:2.0:1788587163.059515:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8bac87e8ca00:6709] 0 exiting: rc = 1 00000100:00100000:3.0:1788587163.059748:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059770:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059775:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059781:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059786:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059791:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059797:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059803:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059809:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059814:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059819:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059823:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059829:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059833:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059839:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059873:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059878:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059883:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059888:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059893:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059898:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059903:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059928:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059934:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059939:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059945:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059960:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059966:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059971:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059977:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059981:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059986:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059991:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.059995:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060001:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060006:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060018:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060023:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060028:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060034:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060039:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060044:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060048:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060053:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060058:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060062:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060067:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060073:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060078:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060083:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060088:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060094:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060098:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060104:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060111:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060116:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060121:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060126:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060132:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060136:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060141:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060147:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060152:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.060157:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.061007:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8bacbb8c0800:6712] 1 exiting: rc = 0 00000100:00100000:2.0:1788587163.061261:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8bacbb8c0c00:6713] 2 exiting: rc = 0 00000100:00100000:0.0:1788587163.062293:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8bac87e8ce00:6711] 0 exiting: rc = 1 00000100:00100000:3.0:1788587163.062828:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.062838:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.062908:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.062914:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.062920:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.062926:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.062943:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.062948:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063024:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063031:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063046:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063053:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063059:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063065:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063070:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063075:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063080:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063086:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063091:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063097:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063102:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063108:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063114:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063119:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063124:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063130:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063135:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063140:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063146:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063152:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063157:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063163:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063170:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063177:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063360:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063368:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063374:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063379:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063385:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063390:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063395:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063409:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063415:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063420:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063425:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063430:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063436:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063441:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063446:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063451:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063456:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063461:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063466:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063472:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063479:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063484:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063490:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063496:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063501:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063507:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063513:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063519:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063524:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.063531:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587163.071081:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8bac88313000:6714] 0 exiting: rc = 1 00000100:00100000:3.0:1788587163.071780:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8bac92cb1400:6715] 1 exiting: rc = 0 00000100:00100000:3.0:1788587163.071873:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071881:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071886:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071892:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071897:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071901:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071906:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071911:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071915:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071921:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.071926:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072284:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072291:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072296:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072301:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072306:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072311:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072316:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072321:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072326:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072330:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072334:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072338:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072342:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072347:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072352:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072357:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072362:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072366:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072370:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072375:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072380:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072384:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072388:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072394:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072399:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072404:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072409:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072413:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072418:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072423:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072428:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072433:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072438:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072443:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072447:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072463:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072467:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072472:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072476:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072481:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072486:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072490:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072495:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072499:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072504:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072511:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072515:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072521:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072525:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072530:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072535:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072539:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.072550:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788587163.076518:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8bacae756000:6716] 0 exiting: rc = 1 00000100:00100000:1.0:1788587163.076642:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8bacae757a00:6717] 1 exiting: rc = 0 00000100:00100000:3.0:1788587163.077598:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077615:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077622:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077629:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077732:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077814:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077829:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077909:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077917:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077923:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077929:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077935:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077941:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077947:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077954:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077960:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077966:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.077986:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078004:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078010:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078016:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078023:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078028:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078034:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078039:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078044:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078049:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078055:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078061:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078067:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078091:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078098:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078172:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078178:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078183:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078189:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078205:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078211:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078217:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078223:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078237:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078243:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078261:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078267:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078273:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078280:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078285:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078291:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078296:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078303:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078309:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078314:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078326:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078331:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078348:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078354:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078359:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078364:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078370:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078376:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078382:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078388:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078394:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788587163.078407:0:13352:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788587163.106639:0:13352:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788587183.250427:0:13968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788587192.542511:0:14429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587192.542518:0:14429:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788587192.542640:0:14429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bac82bbc800 00000020:01000004:2.0:1788587192.542657:0:14429:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788587192.542664:0:14429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788587192.542678:0:14429:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8bab812199c0) 00000020:00000080:2.0:1788587192.542693:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788587192.565055:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788587192.566886:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788587192.569780:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788587192.570017:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788587192.570230:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1788587192.570800:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788587192.570960:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788587192.571198:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1788587192.571483:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788587192.572269:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1788587192.574480:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 591: rc = 0 00100000:10000000:3.0:1788587192.575492:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 591: rc = 0 00100000:10000000:3.0:1788587192.576472:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1788587192.576809:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:3.0:1788587192.577500:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1788587192.577921:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:3.0:1788587192.579896:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:3.0:1788587192.580904:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1788587192.582871:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1788587192.584525:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:3.0:1788587192.584965:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:3.0:1788587192.587509:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:3.0:1788587192.588224:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1788587192.588507:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 771: rc = 0 00100000:10000000:3.0:1788587192.589298:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 654: rc = 0 00100000:10000000:3.0:1788587192.589803:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 654: rc = 0 00100000:10000000:3.0:1788587192.590370:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 654: rc = 0 00100000:10000000:3.0:1788587192.590970:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 654: rc = 0 00100000:10000000:3.0:1788587192.591734:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 654: rc = 0 00100000:10000000:3.0:1788587192.592201:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 654: rc = 0 00100000:10000000:3.0:1788587192.593813:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 654: rc = 0 00100000:10000000:2.0:1788587192.596744:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 654: rc = 0 00100000:10000000:2.0:1788587192.597120:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 654: rc = 0 00100000:10000000:2.0:1788587192.597376:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 654: rc = 0 00100000:10000000:2.0:1788587192.597643:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 654: rc = 0 00100000:10000000:2.0:1788587192.597945:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 654: rc = 0 00100000:10000000:2.0:1788587192.598245:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 654: rc = 0 00100000:10000000:2.0:1788587192.598483:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 654: rc = 0 00100000:10000000:2.0:1788587192.598742:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 654: rc = 0 00100000:10000000:2.0:1788587192.599027:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 654: rc = 0 00100000:10000000:2.0:1788587192.599266:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 654: rc = 0 00100000:10000000:2.0:1788587192.603598:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 654: rc = 0 00100000:10000000:2.0:1788587192.603945:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 654: rc = 0 00100000:10000000:2.0:1788587192.604492:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 654: rc = 0 00100000:10000000:2.0:1788587192.605432:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 654: rc = 0 00100000:10000000:2.0:1788587192.606910:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 654: rc = 0 00100000:10000000:2.0:1788587192.607518:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 654: rc = 0 00100000:10000000:2.0:1788587192.609515:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 654: rc = 0 00100000:10000000:2.0:1788587192.611243:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 654: rc = 0 00100000:10000000:2.0:1788587192.611526:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 654: rc = 0 00100000:10000000:2.0:1788587192.611781:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 654: rc = 0 00100000:10000000:2.0:1788587192.613913:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 654: rc = 0 00100000:10000000:2.0:1788587192.614500:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 654: rc = 0 00100000:10000000:2.0:1788587192.620523:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 654: rc = 0 00100000:10000000:2.0:1788587192.620823:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 654: rc = 0 00100000:10000000:3.0:1788587192.628519:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 654: rc = 0 00100000:10000000:3.0:1788587192.630589:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 149: rc = 0 00100000:10000000:3.0:1788587192.633404:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788587192.633575:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 146: rc = 0 00100000:10000000:3.0:1788587192.633830:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788587192.633942:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 146: rc = 0 00100000:10000000:3.0:1788587192.636607:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788587192.639193:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 146: rc = 0 00100000:10000000:3.0:1788587192.639622:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788587192.639721:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 592: rc = 0 00100000:10000000:3.0:1788587192.639948:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788587192.640009:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 592: rc = 0 00100000:10000000:3.0:1788587192.640207:0:14429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788587192.640270:0:14429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 592: rc = 0 00000020:00000080:3.0:1788587192.640567:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788587192.640576:0:14429:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788587192.640588:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab89a47 00000020:01000004:3.0:1788587192.640597:0:14429:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788587192.640603:0:14429:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788587192.640609:0:14429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bac82bbc800 from MGS 00000020:01000004:3.0:1788587192.640613:0:14429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788587192.640623:0:14429:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8bacae3a8000) 00000020:00000080:3.0:1788587192.640643:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788587192.640700:0:14429:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bac82bbc800 from MGS, refs=2 00080000:01000000:3.0:1788587192.640706:0:14429:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788587192.640710:0:14429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab89a55 00000100:00100000:3.0:1788587192.640803:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788587192.640978:0:14429:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788587192.640985:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788587192.643923:0:14429:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788587192.643946:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788587192.645367:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587192.645574:0:14429:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788587192.645580:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788587192.649414:0:14429:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788587192.649428:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788587192.650503:0:14429:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788587192.650513:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788587192.652810:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587192.652815:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587192.652818:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587192.654680:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587192.654686:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587192.654688:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587192.655718:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788587192.661132:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788587192.684512:0:14429:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788587192.684532:0:14429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788587192.684534:0:14429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788587192.688122:0:14438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788587192.688491:0:14429:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788587192.688602:0:14429:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788587192.689159:0:14429:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788587192.689476:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587192.689661:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788587192.689667:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788587192.700907:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788587192.700934:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788587192.708732:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788587192.708744:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788587192.713520:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788587192.713548:0:14429:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.128@tcp' 00000020:01000004:0.0:1788587192.713550:0:14429:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788587192.713581:0:14429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.128@tcp (typ=mgc) 00000020:00000080:0.0:1788587192.713595:0:14429:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.128@tcp (ffff8bacbf730000) 00000020:00000080:0.0:1788587192.713611:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788587192.713702:0:14429:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bacb4eb3000@MGC192.168.204.128@tcp: add connection 192.168.204.128@tcp at head 00010000:00010000:0.0:1788587192.713879:0:14429:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.128@tcp-0 is initialized 00000040:01000000:0.0:1788587192.713885:0:14429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788587192.715321:0:14443:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788587192.717224:0:14444:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788587192.717285:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.128@tcp (uuid b7044063-f08f-49f3-baab-c8410dd7f9cc) 00000020:00000080:0.0:1788587192.717310:0:14429:0:(genops.c:1385:class_connect()) connect: client b7044063-f08f-49f3-baab-c8410dd7f9cc, cookie 0xc1a730b05ab89a63 00000100:00080000:0.0:1788587192.717325:0:14429:0:(import.c:545:import_select_connection()) MGC192.168.204.128@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587192.717332:0:14429:0:(import.c:665:import_select_connection()) MGC192.168.204.128@tcp: import ffff8bacb4eb3000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788587192.717371:0:14429:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbf352a00 x1875469208214912/t0(0) o250->MGC192.168.204.128@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587192.717403:0:14429:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b7044063-f08f-49f3-baab-c8410dd7f9cc->MGS 00000020:01000004:0.0:1788587192.717423:0:14429:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788587192.717429:0:14429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788587192.717442:0:14429:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8bacbf7319c0) 00000020:00000080:0.0:1788587192.717457:0:14429:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788587192.719323:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7044063-f08f-49f3-baab-c8410dd7f9cc:3311:1875469208214912:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788587192.719409:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587192.719515:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208214912 00000100:00100000:2.0:1788587192.719525:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208214912 00000100:00100000:2.0:1788587192.719569:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587192.719576:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875469208214912:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788587192.719603:0:14439:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b7044063-f08f-49f3-baab-c8410dd7f9cc@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1788587192.719646:0:14439:0:(genops.c:1385:class_connect()) connect: client b7044063-f08f-49f3-baab-c8410dd7f9cc, cookie 0xc1a730b05ab89a71 00000100:00080000:2.0:1788587192.721155:0:14439:0:(import.c:65:import_set_state_nolock()) ffff8bac980a9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587192.721243:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+5:3311:x1875469208214912:12345-0@lo:250:mount.lustre.0 Request processed in 1665us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587192.721423:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587192.721478:0:3311:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.128@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788587192.721488:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.128@tcp: connect to target with instance 0 00000100:00080000:2.0:1788587192.721495:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.128@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788587192.721501:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788587192.721504:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacb4eb3000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788587192.721519:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788587192.721523:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788587192.721529:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7044063-f08f-49f3-baab-c8410dd7f9cc:3311:1875469208214912:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788587192.744980:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587192.747554:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788587192.747565:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788587192.748406:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788587192.748414:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788587192.751757:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587192.751771:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788587192.754432:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587192.754683:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788587192.754690:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788587192.760035:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788587192.760051:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788587192.823739:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587192.823988:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788587192.823994:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788587192.831708:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788587192.831723:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788587192.834957:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587192.835166:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587192.835172:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788587192.836245:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788587192.836254:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788587192.836888:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788587192.837067:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788587192.837072:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788587192.838372:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788587192.838382:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788587192.839062:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587192.839229:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788587192.839235:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788587192.840165:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788587192.840173:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788587192.869489:0:14429:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587192.873081:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788587192.873100:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788587192.875500:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788587192.875519:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788587192.876630:0:14429:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788587192.876641:0:14429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788587192.881828:0:14429:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788587192.881892:0:14429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788587192.881900:0:14429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788587192.882160:0:14429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788587192.882199:0:14429:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788587192.882204:0:14429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788587192.882206:0:14429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587192.882207:0:14429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587192.882208:0:14429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587192.882210:0:14429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587192.882211:0:14429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587192.882213:0:14429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587192.882214:0:14429:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587192.882216:0:14429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587192.882218:0:14429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587192.882221:0:14429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788587192.882223:0:14429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587192.882224:0:14429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587192.882225:0:14429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587192.882227:0:14429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587192.882228:0:14429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587192.882229:0:14429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587192.882230:0:14429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587192.882231:0:14429:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587192.882232:0:14429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587192.882233:0:14429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587192.882282:0:14429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788587192.882305:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215040:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788587192.882383:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587192.882444:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788587192.882546:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215040 00000100:00100000:1.0:1788587192.882554:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215040 00000100:00100000:1.0:1788587192.882602:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587192.882611:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+5:14429:x1875469208215040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788587192.882669:0:14442:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788587192.882672:0:14442:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788587192.882675:0:14442:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788587192.884583:0:14463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788587192.885140:0:14442:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788587192.892340:0:14464:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788587192.892350:0:14464:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788587192.892353:0:14464:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788587192.892391:0:14464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788587192.897755:0:14442:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788587192.897768:0:14442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788587192.924210:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+5:14429:x1875469208215040:12345-0@lo:253:mount.lustre.0 Request processed in 41589us (41816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587192.924226:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788587192.924333:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215040:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587192.924349:0:14429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788587192.924352:0:14429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587192.924354:0:14429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788587192.924355:0:14429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587192.924356:0:14429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587192.924358:0:14429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587192.924359:0:14429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587192.924360:0:14429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788587192.924361:0:14429:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788587192.924363:0:14429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587192.924364:0:14429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788587192.924398:0:14429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bac82bbc800 from lustre-MDT0000 10000000:01000000:0.0:1788587192.924431:0:14429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788587192.924434:0:14429:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788587192.924438:0:14429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8bacbf730000 10000000:01000000:0.0:1788587192.924443:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587192.924451:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8bacbf730000 from 1 10000000:01000000:0.0:1788587192.924454:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788587192.924496:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.924507:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.924517:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587192.924537:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587192.924575:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587192.924617:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587192.924767:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215168 00000100:00100000:2.0:1788587192.924773:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215168 00000100:00100000:2.0:1788587192.924821:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587192.924830:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+5:14429:x1875469208215168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587192.924870:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587192.924888:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4200/0xc1a730b05ab89a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89a78 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587192.924911:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4200/0xc1a730b05ab89a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89a78 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587192.924922:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4200/0xc1a730b05ab89a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89a78 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587192.924931:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4200, rc 0) 00000100:00100000:2.0:1788587192.924971:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+6:14429:x1875469208215168:12345-0@lo:101:mount.lustre.0 Request processed in 143us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587192.924978:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587192.925083:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587192.925096:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.925104:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587192.925150:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587192.925175:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587192.925201:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587192.925250:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215296 00000100:00100000:1.0:1788587192.925260:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215296 00000100:00100000:1.0:1788587192.925293:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788587192.925299:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+6:14429:x1875469208215296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587192.925542:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+6:14429:x1875469208215296:12345-0@lo:501:mount.lustre.0 Request processed in 242us (365us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587192.925550:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587192.925713:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215296:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788587192.925739:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788587192.925756:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.925765:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587192.925772:0:14429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bac82bbc800 10000000:01000000:0.0:1788587192.925775:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587192.925780:0:14429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8bac82bbc800 10000000:01000000:0.0:1788587192.925782:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788587192.925784:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8bac82bbc800 from 1 10000000:01000000:0.0:1788587192.925786:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788587192.925802:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99400/0xc1a730b05ab89a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.925809:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99400/0xc1a730b05ab89a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.925823:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99400/0xc1a730b05ab89a86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587192.925836:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587192.925889:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587192.925910:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587192.926194:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215424 00000100:00100000:1.0:1788587192.926199:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215424 00000100:00100000:1.0:1788587192.926238:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788587192.926245:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+6:14429:x1875469208215424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587192.926254:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587192.926269:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbfab4200/0xc1a730b05ab89a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89a86 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587192.926286:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbfab4200/0xc1a730b05ab89a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89a86 expref: 7 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587192.926296:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbfab4200/0xc1a730b05ab89a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89a86 expref: 7 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587192.926303:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4200, rc 0) 00000100:00100000:1.0:1788587192.926342:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+7:14429:x1875469208215424:12345-0@lo:101:mount.lustre.0 Request processed in 97us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587192.926349:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587192.926512:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587192.926524:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99400/0xc1a730b05ab89a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a8d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.926532:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99400/0xc1a730b05ab89a86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89a8d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587192.926544:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788587192.926559:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99400/0xc1a730b05ab89a86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a8d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.926566:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99400/0xc1a730b05ab89a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a8d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587192.926572:0:14429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788587192.926577:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587192.926582:0:14429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8bac82bbc800 10000000:01000000:0.0:1788587192.926585:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788587192.926587:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788587192.926589:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788587192.926603:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98a00/0xc1a730b05ab89a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.926618:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98a00/0xc1a730b05ab89a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.926635:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98a00/0xc1a730b05ab89a94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587192.926650:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587192.926676:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587192.926696:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587192.926754:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215552 00000100:00100000:2.0:1788587192.926759:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215552 00000100:00100000:2.0:1788587192.926794:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788587192.926801:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+7:14429:x1875469208215552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587192.926808:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587192.926817:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5c00/0xc1a730b05ab89a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89a94 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587192.926832:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5c00/0xc1a730b05ab89a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89a94 expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587192.926840:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5c00/0xc1a730b05ab89a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89a94 expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587192.926866:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5c00, rc 0) 00000100:00100000:2.0:1788587192.926903:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+8:14429:x1875469208215552:12345-0@lo:101:mount.lustre.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587192.926908:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587192.926978:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587192.926988:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98a00/0xc1a730b05ab89a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a9b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587192.926996:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98a00/0xc1a730b05ab89a94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89a9b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587192.927049:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587192.927073:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587192.927098:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587192.927144:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215680 00000100:00100000:2.0:1788587192.927148:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215680 00000100:00100000:2.0:1788587192.927177:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788587192.927183:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+8:14429:x1875469208215680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587192.927542:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14429:x1875469208215680:12345-0@lo:501:mount.lustre.0 Request processed in 359us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587192.927549:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587192.927777:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587192.927808:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587192.927878:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587192.927902:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788587192.928527:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215808 00000100:00100000:1.0:1788587192.928535:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215808 00000100:00100000:1.0:1788587192.928582:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788587192.928591:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14429:x1875469208215808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587192.928997:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14429:x1875469208215808:12345-0@lo:503:mount.lustre.0 Request processed in 405us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587192.929217:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587192.930202:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208215808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587192.933458:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14465:1875469208215936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587192.933547:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587192.933593:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb44fd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788587192.933731:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208215936 00000100:00100000:0.0:1788587192.933745:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208215936 00000100:00100000:0.0:1788587192.933797:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587192.933807:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14465:x1875469208215936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788587192.934164:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14465:x1875469208215936:12345-0@lo:502:llog_process_th.0 Request processed in 358us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587192.934172:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788587192.936598:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14465:1875469208215936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788587192.936661:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587192.936676:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587192.936679:0:14465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788587192.936686:0:14465:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788587192.936689:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587192.936707:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8bacbbc28000) 00000020:00000080:1.0:1788587192.936728:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788587192.936735:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788587192.936809:0:14465:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788587192.936816:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab89aa9 00000020:00000080:1.0:1788587192.937092:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788587192.937097:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587192.937101:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587192.937103:0:14465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788587192.937105:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587192.937109:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587192.937110:0:14465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788587192.937113:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788587192.937120:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8bacbbc2cd40) 00000020:00000080:1.0:1788587192.937130:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788587192.937133:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788587192.937135:0:14465:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788587192.937138:0:14465:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788587192.937145:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788587192.937188:0:14465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bac82bbc800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788587192.937200:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8bacbbc2b380) 00000020:00000080:1.0:1788587192.937218:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788587192.937277:0:14465:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788587192.937284:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab89abe 00000020:00000080:1.0:1788587192.939550:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788587192.939570:0:14465:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788587192.939584:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc1a730b05ab89ac5 00080000:01000000:1.0:1788587192.939595:0:14465:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788587192.939600:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab89acc 00010000:00010000:2.0:1788587193.069914:0:14465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788587193.070346:0:14465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788587193.071197:0:14465:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788587193.071703:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8bab8121cd40) 00000020:00000080:2.0:1788587193.071722:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788587193.071804:0:14465:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788587193.071811:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab89ada 00000020:00000080:3.0:1788587193.075952:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788587193.082398:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc1a730b05ab89ae1 00000020:00000080:3.0:1788587193.083590:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788587193.083604:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587193.083611:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.083613:0:14465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788587193.083629:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587193.083635:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.083637:0:14465:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788587193.083649:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788587193.083691:0:14465:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788587193.083708:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587193.083711:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.083713:0:14465:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788587193.083715:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788587193.083717:0:14465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788587193.083718:0:14465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587193.083720:0:14465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788587193.083721:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788587193.083723:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.083724:0:14465:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788587193.083726:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587193.083730:0:14465:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788587193.083733:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.083734:0:14465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788587193.083737:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788587193.083742:0:14465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:3.0:1788587193.083771:0:14465:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788587193.083774:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587193.083789:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8bacae3a99c0) 00000020:00000080:3.0:1788587193.083806:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788587193.083812:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788587193.083893:0:14465:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788587193.083899:0:14465:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788587193.083906:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab89aef 00010000:00080000:3.0:1788587193.083938:0:14465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bacbb9c1000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:3.0:1788587193.085391:0:14465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788587193.085824:0:14465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788587193.085909:0:14465:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788587193.086909:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587193.086973:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788587193.087057:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788587193.097515:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788587193.097525:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788587193.107552:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788587193.107571:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788587193.107612:0:14465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788587193.107644:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab89af6 00000100:00080000:0.0:1788587193.107658:0:14465:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587193.107665:0:14465:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bacbb9c1000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788587193.107706:0:14465:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbf353480 x1875469208216064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587193.107740:0:14465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788587193.107812:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788587193.107817:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587193.107819:0:14465:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788587193.107822:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788587193.107825:0:14465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788587193.107827:0:14465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788587193.107828:0:14465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788587193.107830:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788587193.107832:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587193.107834:0:14465:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788587193.107836:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788587193.107865:0:14465:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788587193.107870:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587193.107871:0:14465:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788587193.107875:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788587193.107894:0:14465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.128@tcp to nid 0x20000c0a8cc80 (192.168.204.128@tcp) 00000020:01000000:0.0:1788587193.107921:0:14465:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788587193.107924:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587193.107936:0:14465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8bacbf734d40) 00000020:00000080:0.0:1788587193.107948:0:14465:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788587193.107953:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788587193.108188:0:14465:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788587193.108195:0:14465:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788587193.108201:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc1a730b05ab89b04 00010000:00080000:0.0:1788587193.108230:0:14465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bab81226800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:0.0:1788587193.108432:0:14465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788587193.108637:0:14465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788587193.108662:0:14465:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788587193.109401:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208216064:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788587193.109460:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469208216064 offset 0 length 520: 4 00000040:00080000:0.0:1788587193.112389:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587193.112491:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788587193.112560:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788587193.118443:0:14471:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788587193.118455:0:14471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788587193.132589:0:14465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788587193.132606:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788587193.132657:0:14465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788587193.132677:0:14465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab89b0b 00000100:00080000:2.0:1788587193.132689:0:14465:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587193.132710:0:14465:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bab81226800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1788587193.132747:0:14465:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab829ed180 x1875469208216192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587193.132836:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208216192:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788587193.132921:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469208216192 offset 0 length 520: 4 00000100:00080000:2.0:1788587193.133013:0:14465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788587193.133070:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587193.133075:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587193.133077:0:14465:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788587193.133080:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587193.133084:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587193.133085:0:14465:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788587193.133088:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788587193.133090:0:14465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788587193.133092:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788587193.133095:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587193.133096:0:14465:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788587193.133098:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788587193.133100:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788587193.133101:0:14465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788587193.133104:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788587193.133132:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14465:1875469208216320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587193.133181:0:14465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587193.133201:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac853af000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587193.133502:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208216320 00000100:00100000:1.0:1788587193.133509:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208216320 00000100:00100000:1.0:1788587193.133571:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788587193.133583:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14465:x1875469208216320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587193.133888:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14465:x1875469208216320:12345-0@lo:502:llog_process_th.0 Request processed in 307us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587193.133896:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587193.134046:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829edf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14465:1875469208216320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587193.134076:0:14465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587193.134082:0:14465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.134083:0:14465:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788587193.134089:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788587193.134304:0:14429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788587193.134324:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788587193.134346:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98a00/0xc1a730b05ab89a94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a9b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.134358:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98a00/0xc1a730b05ab89a94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a9b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788587193.134366:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac82bbc800 from 1 10000000:01000000:1.0:1788587193.134369:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788587193.134406:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.134414:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.134424:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587193.134440:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788587193.134483:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587193.134506:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85b3dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788587193.134686:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208216448 00000100:00100000:2.0:1788587193.134693:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208216448 00000100:00100000:2.0:1788587193.134730:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788587193.134739:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+9:14429:x1875469208216448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587193.134752:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587193.134767:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89b12 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.134802:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.134813:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.134822:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5400, rc 0) 00000100:00100000:2.0:1788587193.134894:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+10:14429:x1875469208216448:12345-0@lo:101:mount.lustre.0 Request processed in 155us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587193.134900:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587193.135029:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587193.135044:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587193.135053:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587193.135594:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216576:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788587193.135662:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587193.135688:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c78540 going to sleep for 11 seconds 00000100:00100000:1.0:1788587193.135947:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208216576 00000100:00100000:1.0:1788587193.135954:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208216576 00000100:00100000:1.0:1788587193.136009:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788587193.136019:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+10:14429:x1875469208216576:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788587193.136038:0:14441:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788587193.136045:0:14441:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788587193.136118:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+10:14429:x1875469208216576:12345-0@lo:256:mount.lustre.0 Request processed in 101us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587193.136125:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788587193.136304:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216576:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788587193.136996:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587193.137370:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587193.137381:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587193.137516:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac82bbc800 from 1 10000000:01000000:2.0:1788587193.137520:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587193.137644:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.137653:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.137663:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587193.137685:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587193.137738:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587193.137815:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac853af000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587193.137929:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208216704 00000100:00100000:1.0:1788587193.137936:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208216704 00000100:00100000:1.0:1788587193.138167:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788587193.138179:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+10:14429:x1875469208216704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587193.138193:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587193.138210:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89b20 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.138252:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.138263:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.138271:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5400, rc 0) 00000100:00100000:1.0:1788587193.138366:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14429:x1875469208216704:12345-0@lo:101:mount.lustre.0 Request processed in 189us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587193.138373:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587193.138640:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587193.138658:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587193.138679:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587193.138741:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587193.138772:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587193.138928:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c78540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587193.139171:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208216832 00000100:00100000:2.0:1788587193.139178:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208216832 00000100:00100000:2.0:1788587193.139208:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587193.139218:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14429:x1875469208216832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587193.139644:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14429:x1875469208216832:12345-0@lo:501:mount.lustre.0 Request processed in 426us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587193.139652:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788587193.139815:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587193.139884:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587193.139930:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587193.139957:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c78540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587193.140103:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208216960 00000100:00100000:2.0:1788587193.140108:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208216960 00000100:00100000:2.0:1788587193.140131:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587193.140138:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14429:x1875469208216960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587193.140279:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14429:x1875469208216960:12345-0@lo:503:mount.lustre.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587193.140286:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587193.140381:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208216960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587193.141398:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14473:1875469208217088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587193.141466:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587193.141647:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587193.141691:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217088 00000100:00100000:2.0:1788587193.141699:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217088 00000100:00100000:2.0:1788587193.141796:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788587193.141808:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14473:x1875469208217088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587193.142255:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14473:x1875469208217088:12345-0@lo:502:llog_process_th.0 Request processed in 447us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587193.142264:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587193.142366:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14473:1875469208217088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587193.142396:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587193.142407:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.142409:0:14473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788587193.142417:0:14473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bac82bbc800 00000020:00000080:3.0:1788587193.142420:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587193.142428:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587193.142430:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.142431:0:14473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788587193.142433:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587193.142435:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.142443:0:14473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788587193.142447:0:14473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bac82bbc800 00000020:00000080:3.0:1788587193.142448:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788587193.142514:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587193.142517:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.142518:0:14473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788587193.142521:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788587193.142523:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.142524:0:14473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788587193.142527:0:14473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bac82bbc800 00000020:00000080:3.0:1788587193.142539:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788587193.142577:0:14473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14473:1875469208217216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587193.142613:0:14473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587193.147724:0:14473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac87ce4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788587193.147861:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217216 00000100:00100000:1.0:1788587193.147871:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217216 00000100:00100000:1.0:1788587193.147924:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788587193.147934:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14473:x1875469208217216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587193.148194:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14473:x1875469208217216:12345-0@lo:502:llog_process_th.0 Request processed in 261us (5579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587193.148201:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788587193.148374:0:14473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14473:1875469208217216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788587193.148407:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788587193.148415:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587193.148417:0:14473:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788587193.148423:0:14473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788587193.152698:0:14429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788587193.152737:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788587193.152759:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.152771:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587193.152820:0:14429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788587193.152823:0:14429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bac82bbc800 10000000:01000000:2.0:1788587193.152832:0:14429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bac82bbc800 10000000:01000000:2.0:1788587193.152837:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587193.152861:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bac82bbc800 from 1 10000000:01000000:2.0:1788587193.152865:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788587193.152903:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5000/0xc1a730b05ab89b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.152911:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5000/0xc1a730b05ab89b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.152922:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5000/0xc1a730b05ab89b2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587193.152950:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208217344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587193.153018:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587193.153063:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881bf300 going to sleep for 11 seconds 00000100:00100000:0.0:1788587193.153173:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217344 00000100:00100000:0.0:1788587193.153182:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217344 00000100:00100000:0.0:1788587193.153224:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587193.153232:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14429:x1875469208217344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587193.153245:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587193.153260:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a98400/0xc1a730b05ab89b35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89b2e expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.153282:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a98400/0xc1a730b05ab89b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89b2e expref: 12 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.153293:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a98400/0xc1a730b05ab89b35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b2e expref: 12 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.153310:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98400, rc 0) 00000100:00100000:0.0:1788587193.153351:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14429:x1875469208217344:12345-0@lo:101:mount.lustre.0 Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587193.153358:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788587193.154984:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208217344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587193.155014:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5000/0xc1a730b05ab89b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b35 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.155026:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5000/0xc1a730b05ab89b2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89b35 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587193.155098:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208217472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587193.155154:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587193.155197:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881bf300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587193.155645:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217472 00000100:00100000:1.0:1788587193.155654:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217472 00000100:00100000:1.0:1788587193.155709:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788587193.155718:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14429:x1875469208217472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587193.156014:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14429:x1875469208217472:12345-0@lo:501:mount.lustre.0 Request processed in 296us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587193.156022:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788587193.156680:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208217472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587193.156726:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208217600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587193.156779:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587193.156811:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881bf300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587193.156832:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217600 00000100:00100000:2.0:1788587193.156838:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217600 00000100:00100000:2.0:1788587193.156898:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587193.156906:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14429:x1875469208217600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587193.157056:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14429:x1875469208217600:12345-0@lo:503:mount.lustre.0 Request processed in 151us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587193.157063:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788587193.157105:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208217600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587193.158870:0:14478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14478:1875469208217728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587193.158942:0:14478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587193.158974:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217728 00000100:00100000:2.0:1788587193.158980:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217728 00000100:00100000:2.0:1788587193.159013:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587193.159021:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14478:x1875469208217728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788587193.159235:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14478:x1875469208217728:12345-0@lo:502:llog_process_th.0 Request processed in 213us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587193.159242:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788587193.159291:0:14478:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881bf300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587193.159310:0:14478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14478:1875469208217728:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788587193.159365:0:14478:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788587193.159379:0:14478:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8bab8121b380) 00000020:00000080:2.0:1788587193.159397:0:14478:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788587193.159461:0:14478:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bac82bbc800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788587193.159469:0:14478:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bac82bbc800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788587193.159471:0:14478:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bac82bbc800 4 00010000:00080000:2.0:1788587193.159495:0:14478:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bacbbcd7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.128@tcp at head 00010000:00010000:2.0:1788587193.167137:0:14478:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788587193.167354:0:14478:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788587193.167393:0:14478:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788587193.167407:0:14478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc1a730b05ab89b43 00000100:00080000:2.0:1788587193.167419:0:14478:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788587193.167426:0:14478:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8bacbbcd7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1788587193.167466:0:14478:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab829ed500 x1875469208217856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587193.167514:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208217856:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788587193.170680:0:14478:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788587193.172099:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587193.172300:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217856 00000100:00100000:0.0:1788587193.172310:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217856 00000100:00100000:0.0:1788587193.172345:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587193.172354:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875469208217856:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587193.172415:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875469208217856:12345-0@lo:38:llog_process_th.0 Request processed in 62us (323us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788587193.172422:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587193.175287:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587193.175302:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbbcd7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587193.175309:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788587193.175314:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208217856:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788587193.178769:0:14478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14478:1875469208217984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788587193.178874:0:14478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587193.178922:0:14478:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac908cc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788587193.179380:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208217984 00000100:00100000:1.0:1788587193.179390:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208217984 00000100:00100000:1.0:1788587193.179502:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788587193.179511:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14478:x1875469208217984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788587193.180326:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14478:x1875469208217984:12345-0@lo:502:llog_process_th.0 Request processed in 813us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587193.180335:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788587193.180612:0:14478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7044063-f08f-49f3-baab-c8410dd7f9cc:14478:1875469208217984:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788587193.180657:0:14478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788587193.184698:0:14429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788587193.184733:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587193.184753:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5000/0xc1a730b05ab89b2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b35 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.184765:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5000/0xc1a730b05ab89b2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b35 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788587193.184818:0:14429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788587193.184820:0:14429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587193.184821:0:14429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587193.184827:0:14429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587193.184828:0:14429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587193.184829:0:14429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587193.184830:0:14429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587193.184832:0:14429:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587193.184833:0:14429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587193.184835:0:14429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587193.184838:0:14429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788587193.184870:0:14429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587193.184872:0:14429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587193.184873:0:14429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587193.184874:0:14429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587193.184875:0:14429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587193.184876:0:14429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587193.184877:0:14429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587193.184878:0:14429:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587193.184879:0:14429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587193.184879:0:14429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587193.184907:0:14429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788587193.184925:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208218112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587193.185005:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587193.185042:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587193.185073:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208218112 00000100:00100000:2.0:1788587193.185080:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208218112 00000100:00100000:2.0:1788587193.185122:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587193.185130:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14429:x1875469208218112:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788587193.185158:0:14439:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788587193.185173:0:14439:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788587193.289353:0:14439:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788587193.289374:0:14439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788587193.289537:0:14463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788587193.289543:0:14463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788587193.289568:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.289588:0:14463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.289598:0:14463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.289650:0:14463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587193.289666:0:14463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 12 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587193.289680:0:14463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14463:1875469208218240:0@lo:104: 00000100:00100000:1.0:1788587193.289741:0:14463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587193.289795:0:14463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a28900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587193.290401:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208218240 00000100:00100000:0.0:1788587193.290410:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208218240 00000100:00100000:0.0:1788587193.290460:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587193.290469:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14463:x1875469208218240:12345-0@lo:104: 00010000:00010000:0.0:1788587193.290483:0:14430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.290548:0:14430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587193.290554:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14463:x1875469208218240:12345-0@lo:104: Request processed in 87us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587193.290559:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788587193.290581:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587193.290587:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.290593:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4c00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587193.290609:0:14436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.290628:0:14436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587193.290635:0:14436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587193.290641:0:14436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587193.290739:0:14436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.290746:0:14436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587193.290765:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.290771:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbfab4c00/0xc1a730b05ab89b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b19 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.290789:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587193.290791:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587193.291015:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587193.291049:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208218368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587193.291244:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587193.291333:0:14463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b83480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14463:1875469208218240:0@lo:104: 00010000:00010000:0.0:1788587193.291353:0:14463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587193.291471:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208218368 00000100:00100000:2.0:1788587193.291477:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208218368 00010000:00010000:2.0:1788587193.291500:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 13 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587193.291528:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587193.291536:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+13:3314:x1875469208218368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587193.291555:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587193.291561:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 13 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291571:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 13 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291586:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab89b12 expref: 13 pid: 14439 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291600:0:14432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291609:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788587193.291635:0:14432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002092551s 00010000:00010000:2.0:1788587193.291639:0:14432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291645:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291719:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291726:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291730:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587193.291734:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291747:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291760:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587193.291769:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587193.292025:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:3314:x1875469208218368:12345-0@lo:103:ldlm_bl.0 Request processed in 490us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587193.292033:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587193.292312:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208218368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587193.292340:0:14463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.292348:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587193.292354:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbfab4000/0xc1a730b05ab89b4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587193.310026:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14429:x1875469208218112:12345-0@lo:253:mount.lustre.0 Request processed in 124884us (125010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587193.310041:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788587193.310162:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:14429:1875469208218112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587193.310177:0:14429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788587193.310181:0:14429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587193.310182:0:14429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788587193.310184:0:14429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587193.310185:0:14429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587193.310186:0:14429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587193.310187:0:14429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587193.310189:0:14429:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788587193.310190:0:14429:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788587193.310192:0:14429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587193.310194:0:14429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788587193.310208:0:14429:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788587193.318205:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587193.318368:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587193.318663:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587193.318808:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587193.319098:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587193.319248:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587193.322104:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587193.322718:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587193.323121:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587193.323675:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788587193.324098:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788587193.324286:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788587193.394020:0:14429:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788587193.396164:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788587193.399301:0:14487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788587193.399455:0:14487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587193.401513:0:14487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788587193.401598:0:14487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788587193.401602:0:14487:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788587193.403554:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788587193.403693:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788587193.404140:0:14429:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788587193.404147:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788587193.404275:0:14429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788587193.405559:0:14486:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788587193.405566:0:14486:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788587193.406464:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788587193.407086:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788587193.407121:0:14429:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788587193.412086:0:14429:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788587193.418780:0:14429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788587193.468540:0:14429:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788587193.468590:0:14429:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0e201bb7988 00100000:10000000:3.0:1788587193.468598:0:14429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788587193.470330:0:14429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788587193.470349:0:14429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788587193.470425:0:14429:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788587193.470450:0:14429:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788587193.668092:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788587194.179022:0:14444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587194.179030:0:14444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac82bbc800 from 6 10000000:01000000:0.0:1788587194.179035:0:14444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587194.179082:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587194.179093:0:14444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587194.179103:0:14444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587194.179129:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208218496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587194.179206:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587194.179295:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82c62b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587194.179315:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208218496 00000100:00100000:2.0:1788587194.179323:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208218496 00000100:00100000:2.0:1788587194.179381:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788587194.179390:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14444:x1875469208218496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587194.179403:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587194.179416:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89b51 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587194.179440:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 12 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587194.179452:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 12 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587194.179460:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5400, rc 0) 00000100:00100000:2.0:1788587194.179506:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208218496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587194.179646:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788587194.179671:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208218496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587194.179685:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587194.179695:0:14444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587194.179744:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208218624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788587194.179773:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587194.179797:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82c62b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587194.179928:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208218624 00000100:00100000:2.0:1788587194.179933:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208218624 00000100:00100000:3.0:1788587194.180033:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788587194.180041:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208218624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788587194.180057:0:14439:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788587194.180073:0:14439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788587194.180077:0:14439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788587194.180174:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208218624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587194.180181:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788587194.180284:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208218624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788587194.180338:0:14444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788587194.180345:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587194.180352:0:14444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587194.248554:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587194.692089:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587195.268590:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587195.716866:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587196.740331:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587197.763933:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587198.143051:0:14729:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788587198.467585:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587198.467604:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587198.467607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788587198.467610:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788587198.467613:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788587198.467617:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788587198.467620:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bacbbcd7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788587198.467633:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8bacbbcd7800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:1.0:1788587198.467657:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacb5b82680 x1875469208218880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587198.467782:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788587198.467797:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208218752:0@lo:400:kworker.0 00000100:00100000:1.0:1788587198.467899:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587198.468009:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208218752 00000100:00100000:2.0:1788587198.468018:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208218752 00000100:00100000:2.0:1788587198.468068:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587198.468078:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:3314:x1875469208218752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587198.468134:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:3314:x1875469208218752:12345-0@lo:400:kworker.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587198.468141:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788587198.468176:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208218880:0@lo:38:kworker.0 00000100:00100000:2.0:1788587198.468201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587198.468252:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208218752:0@lo:400:kworker.0 00000100:00100000:1.0:1788587198.470666:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208218880 00000100:00100000:1.0:1788587198.470684:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208218880 00000100:00100000:1.0:1788587198.470738:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587198.470747:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875469208218880:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788587198.470776:0:14449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:1.0:1788587198.470818:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc1a730b05ab89b5f 00000004:00100000:1.0:1788587198.470836:0:14449:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788587198.471007:0:14449:0:(import.c:65:import_set_state_nolock()) ffff8bac9073b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788587198.471093:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875469208218880:12345-0@lo:38:kworker.0 Request processed in 346us (2890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587198.471101:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788587198.472440:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bacb5b82680 x1875469208218880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587198.472462:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788587198.472471:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788587198.472477:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788587198.472480:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbbcd7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788587198.472486:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875469208218880:0@lo:38:kworker.0 00010000:00010000:3.0:1788587198.787807:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587199.811213:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587200.835015:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788587201.201049:0:14880:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa9a94a10 20000000:00000080:2.0:1788587201.201068:0:14880:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bacb5cbbc00 uarg=0000000000000000 20000000:01000000:2.0:1788587201.201107:0:14880:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788587201.201117:0:14880:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788587201.201123:0:14880:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788587201.203405:0:14881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788587201.203939:0:14880:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788587201.213472:0:14880:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788587201.213518:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587201.213539:0:14880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587201.213548:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587201.213600:0:14880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587201.213615:0:14880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 11 pid: 14441 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587201.213630:0:14880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14880:1875469208219008:0@lo:104: 00000100:00100000:2.0:1788587201.213696:0:14880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587201.213744:0:14880:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f20000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587201.213923:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208219008 00000100:00100000:0.0:1788587201.213931:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208219008 00000100:00100000:1.0:1788587201.214050:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587201.214063:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14880:x1875469208219008:12345-0@lo:104: 00010000:00010000:1.0:1788587201.214079:0:14431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587201.214155:0:14431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788587201.214162:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14880:x1875469208219008:12345-0@lo:104: Request processed in 103us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587201.214171:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788587201.215409:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587201.215420:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.215431:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4800 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587201.215435:0:14435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.215443:0:14435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587201.215485:0:14435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587201.215490:0:14435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587201.215588:0:14435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.215595:0:14435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587201.215629:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.215636:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4800/0xc1a730b05ab89b20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b27 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.215657:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587201.215659:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587201.215661:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587201.215701:0:14880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14880:1875469208219008:0@lo:104: 00010000:00010000:3.0:1788587201.215724:0:14880:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587201.215918:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208219136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788587201.215967:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587201.216879:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208219136 00000100:00100000:3.0:1788587201.216889:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208219136 00010000:00010000:3.0:1788587201.216929:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 12 pid: 14441 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587201.216968:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587201.216979:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:3312:x1875469208219136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587201.216991:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587201.217007:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 12 pid: 14441 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217019:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 12 pid: 14441 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217035:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbfab5400/0xc1a730b05ab89b27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab89b20 expref: 12 pid: 14441 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217056:0:14432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217065:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217081:0:14432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217088:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217095:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217101:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217107:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587201.217110:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217118:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217147:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587201.217158:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587201.217212:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:3312:x1875469208219136:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587201.217220:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788587201.217276:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208219136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587201.217313:0:14880:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587201.217321:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587201.217328:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89b66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587201.861426:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587202.883176:0:14444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587202.883185:0:14444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac82bbc800 from 10 10000000:01000000:2.0:1788587202.883192:0:14444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587202.883239:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587202.883252:0:14444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587202.883270:0:14444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587202.883299:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208219264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587202.883384:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587202.883463:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f200c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788587202.883673:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587202.883883:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208219264 00000100:00100000:0.0:1788587202.883891:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208219264 00000100:00100000:0.0:1788587202.883954:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587202.883982:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+11:14444:x1875469208219264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587202.883996:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587202.884018:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89b6d expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587202.884060:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587202.884071:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587202.884081:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99800, rc 0) 00000100:00100000:0.0:1788587202.884134:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208219264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587202.884140:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788587202.884333:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208219264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788587202.884348:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587202.884357:0:14444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587202.884441:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208219392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587202.884470:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587202.884489:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587202.884558:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208219392 00000100:00100000:1.0:1788587202.884562:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208219392 00000100:00100000:1.0:1788587202.884600:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587202.884607:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208219392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587202.884872:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208219392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587202.884880:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788587202.885200:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208219392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788587202.885231:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208219520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587202.885269:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587202.885300:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac92f200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587202.888935:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208219520 00000100:00100000:1.0:1788587202.888952:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208219520 00000100:00100000:1.0:1788587202.889039:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788587202.889050:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208219520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587202.889292:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:14444:x1875469208219520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (4022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587202.889299:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788587202.889518:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208219520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587202.894133:0:14942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788587202.896896:0:14444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788587202.896935:0:14444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587202.896949:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587202.896962:0:14444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587203.591611:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587193/real 1788587193] req@ffff8bab829ed180 x1875469208216192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587203.591647:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bab829ed180 x1875469208216192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587203.591658:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587193/real 1788587193] req@ffff8bacbf353480 x1875469208216064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587203.591670:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bacbf353480 x1875469208216064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587203.591688:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788587203.595516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587203.595527:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587203.595530:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587203.595534:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587203.595538:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587203.595548:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:0.0:1788587203.595554:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587203.595562:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bab81226800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788587203.595609:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbf350380 x1875469208219648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788587203.595680:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208219776:0@lo:400:kworker.0 00000100:00100000:0.0:1788587203.595755:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587203.595907:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208219776 00000100:00100000:0.0:1788587203.595917:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208219776 00000100:00100000:0.0:1788587203.595979:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788587203.596003:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208219776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587203.596056:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208219776:12345-0@lo:400:kworker.0 Request processed in 55us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587203.596064:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788587203.596330:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bacbf351180 x1875469208219776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587203.596344:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208219776:0@lo:400:kworker.0 00000100:00080000:3.0:1788587203.597071:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587203.597078:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208216192:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788587203.597086:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbb9c1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788587203.597093:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788587203.597097:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208216064:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788587203.597121:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208219648:0@lo:8:kworker.0 00000400:00000100:3.0:1788587203.597164:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469208219648 offset 0 length 520: 4 00000100:00080000:0.0:1788587203.597406:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587203.597411:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788587203.597413:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bacbb9c1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587203.597427:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:0.0:1788587203.597431:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788587203.597436:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bacbb9c1000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788587203.597467:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbf351180 x1875469208219904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788587203.600049:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208219904:0@lo:8:kworker.0 00000400:00000100:2.0:1788587203.600107:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875469208219904 offset 0 length 520: 4 00010000:00010000:2.0:1788587203.908255:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587204.931036:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587205.507496:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788587205.958592:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587206.979024:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788587207.011094:0:15129:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587207.011098:0:15129:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788587207.011215:0:15129:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bacbbcd6800 00000020:01000004:2.0:1788587207.011233:0:15129:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788587207.011245:0:15129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788587207.011259:0:15129:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8bab81218000) 00000020:00000080:2.0:1788587207.011275:0:15129:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788587207.046960:0:15129:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788587207.047336:0:15129:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788587207.049879:0:15129:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788587207.050260:0:15129:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788587207.050510:0:15129:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788587207.052249:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 421: rc = 0 00100000:10000000:1.0:1788587207.052423:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 421: rc = 0 00100000:10000000:1.0:1788587207.052589:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 421: rc = 0 00100000:10000000:1.0:1788587207.054459:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:1.0:1788587207.056547:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 768: rc = 0 00100000:10000000:1.0:1788587207.060367:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 768: rc = 0 00100000:10000000:1.0:1788587207.060674:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:1.0:1788587207.063561:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:1.0:1788587207.066506:0:15129:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 768: rc = 0 00000020:00000080:3.0:1788587207.081958:0:15129:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788587207.081973:0:15129:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788587207.081986:0:15129:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1a730b05ab89b82 00000020:01000004:3.0:1788587207.081994:0:15129:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788587207.082015:0:15129:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788587207.082019:0:15129:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788587207.082026:0:15129:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788587207.082031:0:15129:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788587207.082043:0:15129:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8bacae3acd40) 00000020:00000080:3.0:1788587207.082053:0:15129:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788587207.084692:0:15129:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587207.084957:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788587207.084964:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788587207.092180:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788587207.093161:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788587207.094093:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587207.094102:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788587207.100746:0:15129:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587207.100953:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788587207.100960:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788587207.102509:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788587207.102521:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788587207.136305:0:15129:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788587207.136578:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788587207.136587:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788587207.138290:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788587207.138302:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788587207.140575:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788587207.140588:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788587207.142558:0:15129:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788587207.144459:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788587207.144472:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788587207.146138:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788587207.146155:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788587207.211615:0:15129:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788587207.212368:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788587207.212378:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788587207.213787:0:15129:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788587207.213801:0:15129:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788587207.215530:0:15129:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788587207.215557:0:15129:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788587207.215568:0:15129:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788587207.230000:0:15129:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788587207.230037:0:15129:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.128@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788587207.230041:0:15129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788587207.230043:0:15129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587207.230045:0:15129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587207.230046:0:15129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587207.230048:0:15129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587207.230049:0:15129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587207.230050:0:15129:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587207.230052:0:15129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587207.230058:0:15129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587207.230062:0:15129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788587207.230063:0:15129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587207.230064:0:15129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587207.230065:0:15129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587207.230066:0:15129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587207.230067:0:15129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587207.230068:0:15129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587207.230069:0:15129:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587207.230070:0:15129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587207.230071:0:15129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788587207.230097:0:15129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788587207.230322:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220032:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788587207.230406:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.230526:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac83228a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.230578:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220032 00000100:00100000:2.0:1788587207.230586:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220032 00000100:00100000:2.0:1788587207.230679:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788587207.230690:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:15129:x1875469208220032:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788587207.230736:0:14439:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788587207.230739:0:14439:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788587207.230743:0:14439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788587207.251111:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:15129:x1875469208220032:12345-0@lo:253:mount.lustre.0 Request processed in 20397us (20678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.251127:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788587207.251400:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587207.251417:0:15129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788587207.251420:0:15129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587207.251421:0:15129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587207.251423:0:15129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587207.251424:0:15129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587207.251425:0:15129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587207.251426:0:15129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587207.251427:0:15129:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587207.251429:0:15129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587207.251430:0:15129:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788587207.251450:0:15129:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bacbbcd6800 from lustre-OST0000 10000000:01000000:0.0:1788587207.251476:0:15129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788587207.251480:0:15129:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788587207.251487:0:15129:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bacbf730000 local copy 00010000:00010000:0.0:1788587207.251499:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587207.251750:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587207.251801:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.251926:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac832283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587207.254498:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220160 00000100:00100000:1.0:1788587207.254518:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220160 00000100:00100000:1.0:1788587207.254594:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788587207.254605:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:15129:x1875469208220160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587207.254947:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:15129:x1875469208220160:12345-0@lo:501:mount.lustre.0 Request processed in 343us (3144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587207.254956:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587207.255166:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220160:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788587207.255192:0:15129:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788587207.255378:0:15129:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788587207.255387:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.255397:0:15129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587207.255422:0:15129:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bacbbcd6800 10000000:01000000:0.0:1788587207.255427:0:15129:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788587207.255431:0:15129:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8bacbf730000 10000000:01000000:0.0:1788587207.255433:0:15129:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788587207.255436:0:15129:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8bacbf730000 from 1 10000000:01000000:0.0:1788587207.255439:0:15129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788587207.255471:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98600/0xc1a730b05ab89b90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.255479:0:15129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98600/0xc1a730b05ab89b90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.255489:0:15129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98600/0xc1a730b05ab89b90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587207.255507:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587207.255545:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.255594:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac832283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587207.255746:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220288 00000100:00100000:3.0:1788587207.255753:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220288 00000100:00100000:3.0:1788587207.255783:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788587207.255791:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+12:15129:x1875469208220288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587207.255804:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587207.255820:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050200/0xc1a730b05ab89b97 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89b90 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.255874:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050200/0xc1a730b05ab89b97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89b90 expref: 13 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.255884:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050200/0xc1a730b05ab89b97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b90 expref: 13 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.255893:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050200, rc 0) 00000100:00100000:3.0:1788587207.255927:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+13:15129:x1875469208220288:12345-0@lo:101:mount.lustre.0 Request processed in 136us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.255933:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587207.256211:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587207.256225:0:15129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98600/0xc1a730b05ab89b90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b97 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.256234:0:15129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98600/0xc1a730b05ab89b90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89b97 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587207.256252:0:15129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788587207.256270:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98600/0xc1a730b05ab89b90 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b97 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.256278:0:15129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98600/0xc1a730b05ab89b90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89b97 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587207.256284:0:15129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788587207.256288:0:15129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587207.256293:0:15129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788587207.256295:0:15129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788587207.256313:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98000/0xc1a730b05ab89b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.256320:0:15129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98000/0xc1a730b05ab89b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.256328:0:15129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98000/0xc1a730b05ab89b9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587207.256341:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587207.256378:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.256418:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac832283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.256524:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220416 00000100:00100000:2.0:1788587207.256529:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220416 00000100:00100000:2.0:1788587207.256566:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788587207.256574:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+13:15129:x1875469208220416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587207.256581:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587207.256591:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab89ba5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89b9e expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.256606:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab89ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89b9e expref: 14 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.256616:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5600/0xc1a730b05ab89ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b9e expref: 14 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.256623:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5600, rc 0) 00000100:00100000:2.0:1788587207.256663:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220416:12345-0@lo:101:mount.lustre.0 Request processed in 90us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.256669:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587207.256779:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587207.256790:0:15129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98000/0xc1a730b05ab89b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89ba5 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.256798:0:15129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98000/0xc1a730b05ab89b9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89ba5 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587207.257603:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788587207.267513:0:15129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587207.270150:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788587207.270247:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788587207.270285:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788587207.270339:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788587207.270396:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788587207.270427:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788587207.270502:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788587207.270511:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788587207.270616:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587207.270690:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.270748:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac83228600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587207.271063:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220544 00000100:00100000:1.0:1788587207.271072:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220544 00000100:00100000:1.0:1788587207.271140:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788587207.271152:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587207.271579:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220544:12345-0@lo:501:mount.lustre.0 Request processed in 427us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587207.271588:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788587207.271768:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587207.271812:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587207.271881:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.271918:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac83228600 going to sleep for 11 seconds 00000100:00100000:3.0:1788587207.271919:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220672 00000100:00100000:3.0:1788587207.271924:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220672 00000100:00100000:3.0:1788587207.271963:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788587207.271971:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220672:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587207.272304:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220672:12345-0@lo:503:mount.lustre.0 Request processed in 333us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.272311:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788587207.272957:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220672:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587207.276457:0:15129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587207.276559:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587207.276659:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587207.276943:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac8558b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.277406:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220800 00000100:00100000:2.0:1788587207.277416:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220800 00000100:00100000:2.0:1788587207.277470:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587207.277478:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587207.278887:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220800:12345-0@lo:502:mount.lustre.0 Request processed in 361us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.278904:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788587207.279116:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587207.279440:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788587207.279499:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788587207.279534:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788587207.279602:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788587207.279643:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788587207.279752:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788587207.279808:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788587207.279871:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788587207.279928:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788587207.279990:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788587207.280026:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788587207.280086:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788587207.280128:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587207.280191:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587207.280243:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85a7c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.280561:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208220928 00000100:00100000:2.0:1788587207.280569:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208220928 00000100:00100000:2.0:1788587207.280619:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587207.280628:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587207.280832:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208220928:12345-0@lo:502:mount.lustre.0 Request processed in 203us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.280839:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788587207.282329:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208220928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587207.282467:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788587207.282480:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788587207.283400:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788587207.283409:0:15143:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788587207.283414:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788587207.283417:0:15143:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788587207.283423:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788587207.283437:0:15143:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8bacae3ab380) 00000020:00000080:3.0:1788587207.283461:0:15143:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788587207.283467:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788587207.283533:0:15143:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacbbcd6800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788587207.283541:0:15143:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788587207.283547:0:15143:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc1a730b05ab89bb3 00010000:00010000:3.0:1788587207.289774:0:15143:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788587207.291583:0:15143:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788587207.295045:0:15143:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788587207.303240:0:15143:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788587207.303259:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587207.303266:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.303268:0:15143:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788587207.303271:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788587207.303274:0:15143:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788587207.303275:0:15143:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587207.303277:0:15143:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788587207.303278:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788587207.303281:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.303282:0:15143:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788587207.303285:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587207.303287:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.303289:0:15143:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587207.303292:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587207.303294:0:15143:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788587207.303296:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587207.303299:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.303300:0:15143:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788587207.303303:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587207.303305:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.303306:0:15143:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587207.303309:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788587207.303385:0:15143:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587207.303389:0:15143:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.303390:0:15143:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788587207.303393:0:15143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788587207.303570:0:15129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788587207.303599:0:15129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788587207.303623:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98000/0xc1a730b05ab89b9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89ba5 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.303634:0:15129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98000/0xc1a730b05ab89b9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89ba5 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587207.303641:0:15129:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacbbcd6800 from 1 10000000:01000000:2.0:1788587207.303644:0:15129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587207.303683:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.303692:0:15129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.303705:0:15129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587207.303743:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587207.303823:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.303914:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587207.304374:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221056 00000100:00100000:1.0:1788587207.304386:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221056 00000100:00100000:1.0:1788587207.304448:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788587207.304457:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+14:15129:x1875469208221056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587207.304474:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587207.304490:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89bba expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.304535:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 15 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.304549:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 15 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.304558:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab5800, rc 0) 00000100:00100000:1.0:1788587207.304603:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221056:12345-0@lo:101:mount.lustre.0 Request processed in 147us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587207.304609:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587207.304718:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587207.304733:0:15129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.304742:0:15129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587207.305309:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788587207.305648:0:15129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788587207.305910:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788587207.305952:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788587207.306012:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788587207.306020:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788587207.306087:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587207.306141:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.306181:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587207.306569:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221184 00000100:00100000:3.0:1788587207.306578:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221184 00000100:00100000:3.0:1788587207.306621:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788587207.306630:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587207.306895:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221184:12345-0@lo:501:mount.lustre.0 Request processed in 264us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.306904:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788587207.307236:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587207.307279:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587207.307322:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.307354:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788587207.307819:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221312 00000100:00100000:3.0:1788587207.307826:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221312 00000100:00100000:3.0:1788587207.307899:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587207.307916:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587207.308111:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221312:12345-0@lo:503:mount.lustre.0 Request processed in 196us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.308119:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788587207.308309:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221312:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587207.310664:0:15129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587207.310819:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587207.310936:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587207.310990:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98080000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587207.313618:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221440 00000100:00100000:0.0:1788587207.313636:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221440 00000100:00100000:0.0:1788587207.313706:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788587207.313718:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587207.314019:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221440:12345-0@lo:502:mount.lustre.0 Request processed in 303us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.314028:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788587207.316239:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788587207.316599:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788587207.316668:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788587207.316732:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788587207.316770:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788587207.316804:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788587207.316871:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788587207.316906:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788587207.316938:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788587207.316981:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587207.317053:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.317094:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587207.318340:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221568 00000100:00100000:0.0:1788587207.318365:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221568 00000100:00100000:0.0:1788587207.318431:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788587207.318440:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587207.319252:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221568:12345-0@lo:502:mount.lustre.0 Request processed in 809us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.319263:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788587207.319553:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587207.319724:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788587207.319740:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788587207.325738:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587207.325751:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.325753:0:15147:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587207.325760:0:15147:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacbbcd6800 00000020:00000080:1.0:1788587207.325763:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587207.325770:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587207.325772:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.325773:0:15147:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788587207.325776:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587207.325778:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.325779:0:15147:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587207.325782:0:15147:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacbbcd6800 00000020:00000080:1.0:1788587207.325784:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587207.325868:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587207.325872:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.325873:0:15147:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788587207.325876:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587207.325878:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.325879:0:15147:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587207.325882:0:15147:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bacbbcd6800 00000020:00000080:1.0:1788587207.325900:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587207.325935:0:15147:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587207.325938:0:15147:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587207.325939:0:15147:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788587207.325942:0:15147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788587207.326149:0:15129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788587207.326182:0:15129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788587207.326205:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.326218:0:15129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587207.326257:0:15129:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788587207.326260:0:15129:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bacbbcd6800 10000000:01000000:3.0:1788587207.326263:0:15129:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bacbbcd6800 10000000:01000000:3.0:1788587207.326266:0:15129:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788587207.326271:0:15129:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bacbbcd6800 from 1 10000000:01000000:3.0:1788587207.326273:0:15129:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788587207.326310:0:15129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2051400/0xc1a730b05ab89bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.326324:0:15129:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc2051400/0xc1a730b05ab89bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.326336:0:15129:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc2051400/0xc1a730b05ab89bc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587207.326370:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788587207.326431:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587207.326473:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98080300 going to sleep for 11 seconds 00000100:00100000:1.0:1788587207.326545:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221696 00000100:00100000:1.0:1788587207.326552:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221696 00000100:00100000:1.0:1788587207.326596:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788587207.326604:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208221696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587207.326616:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587207.326627:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbfab4400/0xc1a730b05ab89bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89bc8 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.326649:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbfab4400/0xc1a730b05ab89bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89bc8 expref: 16 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.326659:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbfab4400/0xc1a730b05ab89bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89bc8 expref: 16 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587207.326668:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbfab4400, rc 0) 00000100:00100000:1.0:1788587207.326706:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208221696:12345-0@lo:101:mount.lustre.0 Request processed in 103us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587207.326713:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788587207.326802:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587207.326816:0:15129:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc2051400/0xc1a730b05ab89bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bcf expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.326825:0:15129:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc2051400/0xc1a730b05ab89bc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89bcf expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587207.327500:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788587207.327807:0:15129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587207.328076:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788587207.328121:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788587207.328152:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788587207.328196:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788587207.328230:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788587207.328276:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788587207.328309:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788587207.328339:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788587207.328402:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788587207.328436:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788587207.328490:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788587207.328532:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788587207.328563:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788587207.328594:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788587207.328641:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788587207.328678:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788587207.328710:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788587207.328758:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788587207.328793:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788587207.328825:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788587207.328898:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788587207.328934:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788587207.328967:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788587207.329011:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788587207.329046:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788587207.329079:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788587207.329140:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788587207.329179:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788587207.329250:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788587207.329258:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788587207.329370:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587207.329445:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587207.329475:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98080300 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.330961:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221824 00000100:00100000:2.0:1788587207.330976:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221824 00000100:00100000:2.0:1788587207.331035:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788587207.331043:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208221824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587207.331303:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208221824:12345-0@lo:501:mount.lustre.0 Request processed in 260us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.331311:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788587207.344962:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587207.345031:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587207.345130:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.345168:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208221952 00000100:00100000:2.0:1788587207.345174:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208221952 00000100:00100000:0.0:1788587207.345176:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.345233:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788587207.345243:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208221952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587207.345449:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208221952:12345-0@lo:503:mount.lustre.0 Request processed in 207us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.345458:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788587207.345490:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208221952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587207.346969:0:15129:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587207.347052:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208222080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587207.347385:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.347426:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788587207.350011:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222080 00000100:00100000:3.0:1788587207.350030:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222080 00000100:00100000:3.0:1788587207.350101:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788587207.350114:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208222080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587207.350442:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208222080:12345-0@lo:502:mount.lustre.0 Request processed in 330us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.350450:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788587207.350610:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208222080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587207.350949:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788587207.351012:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788587207.351047:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788587207.351264:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788587207.351306:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788587207.351366:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788587207.351404:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788587207.351438:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788587207.351488:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788587207.351535:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788587207.351569:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788587207.352021:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788587207.352063:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788587207.352261:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788587207.352316:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788587207.352360:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788587207.352392:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788587207.352434:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788587207.352464:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788587207.352509:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788587207.352566:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788587207.354473:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788587207.354520:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788587207.354774:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788587207.354818:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788587207.354897:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788587207.354946:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788587207.354981:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788587207.355011:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788587207.355052:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788587207.355084:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788587207.356608:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788587207.356654:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788587207.356715:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788587207.356751:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788587207.356797:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788587207.356856:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788587207.356895:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788587207.356944:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788587207.356980:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788587207.357034:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208222208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587207.357134:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.358051:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.360154:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222208 00000100:00100000:2.0:1788587207.360168:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222208 00000100:00100000:2.0:1788587207.360228:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788587207.360240:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208222208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587207.360552:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208222208:12345-0@lo:502:mount.lustre.0 Request processed in 314us (3418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.360560:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788587207.362631:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208222208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587207.362796:0:15129:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788587207.362812:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788587207.367076:0:15152:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788587207.367105:0:15152:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8bacbf733380) 00000020:00000080:0.0:1788587207.367123:0:15152:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788587207.367208:0:15152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacbbcd6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788587207.367212:0:15152:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bacbbcd6800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788587207.367214:0:15152:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacbbcd6800 3 00010000:00080000:0.0:1788587207.367242:0:15152:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bac8f089800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.128@tcp at head 00010000:00010000:0.0:1788587207.368709:0:15152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788587207.368925:0:15152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788587207.368955:0:15152:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788587207.368968:0:15152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc1a730b05ab89bdd 00000100:00080000:0.0:1788587207.368978:0:15152:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788587207.368984:0:15152:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8bac8f089800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788587207.369018:0:15152:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbf353100 x1875469208222336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788587207.369043:0:15152:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788587207.369075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587207.369079:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587207.369082:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587207.369085:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587207.369604:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875469208222336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788587207.369676:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587207.369751:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222336 00000100:00100000:2.0:1788587207.369758:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222336 00000100:00100000:2.0:1788587207.369787:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587207.369794:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875469208222336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788587207.369815:0:14447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:2.0:1788587207.369915:0:14447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc1a730b05ab89be4 00000004:00100000:2.0:1788587207.369931:0:14447:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788587207.369959:0:14447:0:(import.c:65:import_set_state_nolock()) ffff8bacbf51b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587207.370001:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875469208222336:12345-0@lo:38:llog_process_th.0 Request processed in 207us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587207.370008:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788587207.370041:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bacbf353100 x1875469208222336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587207.370051:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587207.370058:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788587207.370065:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587207.370069:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788587207.370072:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bac8f089800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587207.370077:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875469208222336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587207.375362:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587207.375384:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208222464:0@lo:400:kworker.0 00000100:00100000:0.0:1788587207.375451:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587207.375504:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222464 00000100:00100000:1.0:1788587207.375512:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222464 00000100:00100000:1.0:1788587207.375567:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587207.375576:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208222464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587207.375657:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208222464:12345-0@lo:400:kworker.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587207.375665:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788587207.375690:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8bacbf353b80 x1875469208222464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587207.375705:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208222464:0@lo:400:kworker.0 00000040:00080000:1.0:1788587207.378107:0:15152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788587207.378258:0:15129:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788587207.378292:0:15129:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788587207.378307:0:15129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc2051400/0xc1a730b05ab89bc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bcf expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.378318:0:15129:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc2051400/0xc1a730b05ab89bc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bcf expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788587207.378375:0:15129:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788587207.378377:0:15129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587207.378378:0:15129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587207.378379:0:15129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587207.378381:0:15129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587207.378382:0:15129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587207.378383:0:15129:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587207.378385:0:15129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587207.378386:0:15129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788587207.378390:0:15129:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788587207.378393:0:15129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788587207.378394:0:15129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788587207.378395:0:15129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587207.378396:0:15129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587207.378397:0:15129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587207.378398:0:15129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587207.378399:0:15129:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587207.378400:0:15129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587207.378401:0:15129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788587207.378433:0:15129:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788587207.378453:0:15129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208222592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788587207.378538:0:15129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587207.378574:0:15129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac91a53c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587207.379777:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222592 00000100:00100000:3.0:1788587207.379791:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222592 00000100:00100000:3.0:1788587207.379874:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788587207.379885:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15129:x1875469208222592:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788587207.379918:0:14442:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788587207.379932:0:14442:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788587207.417809:0:14442:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788587207.420966:0:14463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788587207.421041:0:14463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788587207.421073:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.421169:0:14463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 16 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.421180:0:14463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.421227:0:14463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 16 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587207.421245:0:14463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 16 pid: 14442 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587207.421261:0:14463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14463:1875469208222720:0@lo:104: 00000100:00100000:2.0:1788587207.421325:0:14463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587207.421471:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222720 00000100:00100000:3.0:1788587207.421479:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222720 00000100:00100000:3.0:1788587207.421532:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587207.421542:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14463:x1875469208222720:12345-0@lo:104: 00010000:00010000:3.0:1788587207.421556:0:14430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.421609:0:14430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587207.421615:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14463:x1875469208222720:12345-0@lo:104: Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.421623:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788587207.421654:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587207.421660:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.421668:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a98800 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587207.421671:0:14436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.421681:0:14436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587207.421689:0:14436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587207.421716:0:14436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788587207.421748:0:14436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.421755:0:14436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587207.421778:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.421785:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98800/0xc1a730b05ab89b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b58 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.421804:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587207.421807:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587207.421808:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587207.421829:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208222848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587207.421888:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:0.0:1788587207.421957:0:14442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788587207.422383:0:14463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587207.422410:0:14463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14463:1875469208222720:0@lo:104: 00010000:00010000:2.0:1788587207.422431:0:14463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587207.422505:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222848 00000100:00100000:3.0:1788587207.422510:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222848 00010000:00010000:3.0:1788587207.422534:0:14434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 17 pid: 14442 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587207.422601:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788587207.422610:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:3315:x1875469208222848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587207.422622:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587207.422627:0:14434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 17 pid: 14442 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422639:0:14434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 17 pid: 14442 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422662:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5400/0xc1a730b05ab89b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab89b51 expref: 17 pid: 14442 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422677:0:14434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422685:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788587207.422698:0:14434:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002092551s 00010000:00010000:3.0:1788587207.422702:0:14434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422716:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422724:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422730:0:14434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422735:0:14434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587207.422740:0:14434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422748:0:14434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422770:0:14434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587207.422786:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587207.422916:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:3315:x1875469208222848:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587207.422924:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788587207.422972:0:14463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.422980:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587207.422986:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d5800/0xc1a730b05ab89beb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587207.423071:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208222848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587207.432798:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:15129:x1875469208222592:12345-0@lo:253:mount.lustre.0 Request processed in 52905us (54249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587207.432814:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788587207.432976:0:15129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15129:1875469208222592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788587207.432994:0:15129:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788587207.432997:0:15129:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788587207.432999:0:15129:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788587207.433001:0:15129:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587207.433002:0:15129:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587207.433003:0:15129:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587207.433005:0:15129:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587207.433006:0:15129:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587207.433008:0:15129:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587207.433010:0:15129:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788587207.433036:0:15129:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788587207.437763:0:15129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587207.438074:0:15129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587207.438321:0:15129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587207.438497:0:15129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788587207.438652:0:15129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788587207.439512:0:15129:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788587207.440443:0:15129:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788587207.490334:0:15129:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788587207.490355:0:15129:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788587207.490390:0:15129:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788587207.490453:0:15129:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788587207.490467:0:15129:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788587207.490501:0:15129:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788587208.004026:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587209.029390:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788587209.286465:0:14444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788587209.286474:0:14444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac82bbc800 from 7 10000000:01000000:2.0:1788587209.286479:0:14444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788587209.286538:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587209.287076:0:14444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587209.287089:0:14444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587209.287118:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208222976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587209.287462:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587209.287517:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587209.287630:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208222976 00000100:00100000:3.0:1788587209.287644:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208222976 00000100:00100000:3.0:1788587209.287699:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587209.287710:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+15:14444:x1875469208222976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587209.287723:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587209.287738:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89bf2 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587209.287762:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 16 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587209.287773:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 16 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587209.287782:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050e00, rc 0) 00000100:00100000:3.0:1788587209.287826:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:14444:x1875469208222976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587209.287833:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788587209.287900:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208222976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587209.287915:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587209.288063:0:14444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587209.288418:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208223104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587209.289435:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587209.290422:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98080d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587209.290510:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208223104 00000100:00100000:2.0:1788587209.290521:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208223104 00000100:00100000:2.0:1788587209.290577:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788587209.290588:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:14444:x1875469208223104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788587209.290612:0:14442:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788587209.290631:0:14442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788587209.290634:0:14442:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788587209.290875:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:14444:x1875469208223104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 289us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587209.290883:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788587209.291196:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208223104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587209.294499:0:14444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587209.294517:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587209.294530:0:14444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587210.055362:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587211.076080:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587212.099664:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788587212.803148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587212.803155:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788587212.803158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587212.803161:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788587212.803234:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208223360:0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.803317:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587212.803373:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587212.803390:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7044063-f08f-49f3-baab-c8410dd7f9cc:3313:1875469208223232:0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.803420:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587212.803466:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208223488:0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.803495:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587212.803534:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208223360 00000100:00100000:0.0:1788587212.803541:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208223360 00000100:00100000:0.0:1788587212.803581:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208223488 00000100:00100000:0.0:1788587212.803584:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208223488 00000100:00100000:0.0:1788587212.803617:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587212.803626:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208223360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.803676:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208223360:12345-0@lo:400:kworker.0 Request processed in 52us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587212.803683:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587212.803701:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587212.803707:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208223488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.803738:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208223488:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587212.803745:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587212.803762:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208223232 00000100:00100000:0.0:1788587212.803765:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208223232 00000100:00100000:0.0:1788587212.803788:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788587212.803794:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:3313:x1875469208223232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.803823:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:3313:x1875469208223232:12345-0@lo:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587212.803829:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788587212.803906:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbf350a80 x1875469208223488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587212.803932:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208223488:0@lo:400:kworker.0 00000100:00100000:0.0:1788587212.803971:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7044063-f08f-49f3-baab-c8410dd7f9cc:3313:1875469208223232:0@lo:400:kworker.0 00010000:00080000:0.0:1788587212.803981:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbf350000 x1875469208223360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587212.803989:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208223360:0@lo:400:kworker.0 00000100:00080000:0.0:1788587212.807089:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788587213.123223:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788587214.123588:0:15497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788587214.149194:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587215.175147:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587215.753148:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788587216.203722:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587217.220164:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788587217.924258:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587217.924268:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788587217.924271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587217.924275:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788587217.924350:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208223616:0@lo:400:kworker.0 00000100:00100000:0.0:1788587217.924382:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208223872:0@lo:400:kworker.0 00000100:00100000:0.0:1788587217.928298:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587217.928406:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587217.928424:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208223744:0@lo:400:kworker.0 00000100:00100000:0.0:1788587217.928479:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587217.928522:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208223872 00000100:00100000:0.0:1788587217.928532:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208223872 00000100:00080000:3.0:1788587217.928614:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587217.928617:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208223744 00000100:00100000:0.0:1788587217.928622:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208223744 00000100:00100000:0.0:1788587217.928646:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587217.928657:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208223872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587217.928730:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875469208223872:12345-0@lo:400:kworker.0 Request processed in 75us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587217.928738:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587217.928757:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788587217.928765:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208223744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587217.928810:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875469208223744:12345-0@lo:400:kworker.0 Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587217.928816:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788587217.929789:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bab829ef800 x1875469208223744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587217.929812:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875469208223744:0@lo:400:kworker.0 00010000:00080000:0.0:1788587217.929830:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bab829ee680 x1875469208223872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587217.929840:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875469208223872:0@lo:400:kworker.0 00000100:00100000:2.0:1788587217.930023:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587217.931485:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208223616 00000100:00100000:0.0:1788587217.931506:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208223616 00000100:00100000:0.0:1788587217.931575:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788587217.931587:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:3315:x1875469208223616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587217.931780:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:3315:x1875469208223616:12345-0@lo:400:kworker.0 Request processed in 194us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587217.931790:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788587217.931871:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208223616:0@lo:400:kworker.0 00010000:00010000:0.0:1788587218.245031:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587218.631888:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587203/real 1788587203] req@ffff8bacbf351180 x1875469208219904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587218.631938:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bacbf351180 x1875469208219904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587218.631985:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788587203/real 1788587203] req@ffff8bacbf350380 x1875469208219648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587218 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587218.632003:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8bacbf350380 x1875469208219648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788587218 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788587218.632028:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbb9c1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587218.632071:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788587218.632076:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208219904:0@lo:8:kworker.0 00000100:00080000:1.0:1788587218.632083:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587218.632090:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788587218.632093:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208219648:0@lo:8:kworker.0 00000100:00080000:2.0:1788587218.632475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587218.632482:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788587218.632487:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bacbb9c1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587218.632494:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:2.0:1788587218.632502:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587218.632512:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8bacbb9c1000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1788587218.632569:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab829eca80 x1875469208224000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788587218.632608:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788587218.632611:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788587218.632614:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788587218.632617:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:2.0:1788587218.632620:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788587218.632632:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bab81226800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:2.0:1788587218.632645:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab829ee300 x1875469208224128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788587218.633336:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208224000:0@lo:8:kworker.0 00000100:00100000:1.0:1788587218.633437:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587218.633592:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208224128:0@lo:8:kworker.0 00000100:00100000:1.0:1788587218.633631:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587218.634602:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224000 00000100:00100000:3.0:1788587218.634618:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224000 00000100:00100000:3.0:1788587218.634673:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224128 00000100:00100000:3.0:1788587218.634677:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224128 00000100:00100000:3.0:1788587218.634693:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587218.634702:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875469208224000:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587218.635213:0:15130:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:3.0:1788587218.635260:0:15130:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab89c00 00002000:00100000:3.0:1788587218.635282:0:15130:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8bacbbc37800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788587218.635288:0:15130:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788587218.635291:0:15130:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788587218.636426:0:15130:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788587218.636467:0:15130:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc31000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587218.636674:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875469208224000:12345-0@lo:8:kworker.0 Request processed in 1970us (3235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587218.636689:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587218.636728:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587218.636740:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875469208224128:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788587218.636760:0:15130:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788587218.636793:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875469208224128:12345-0@lo:8:kworker.0 Request processed in 58us (3172us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788587218.636799:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788587218.637394:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bab829eca80 x1875469208224000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587218.637410:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788587218.637424:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788587218.637436:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788587218.637442:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788587218.637446:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bacbb9c1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788587218.637537:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788587218.637546:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208224000:0@lo:8:kworker.0 00000100:00080000:1.0:1788587218.637583:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788587218.637587:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788587218.637591:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208224128:0@lo:8:kworker.0 00000004:00080000:2.0:1788587218.637748:0:14469:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788587218.638243:0:14470:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788587218.638271:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14470:1875469208224384:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788587218.638307:0:14469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 540842463899ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788587218.638353:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587218.638404:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac891c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788587218.638578:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208224256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587218.638623:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587218.639247:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224256 00000100:00100000:3.0:1788587218.639259:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224256 00000100:00100000:3.0:1788587218.639345:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587218.639357:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208224256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587218.639403:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587218.639489:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208224256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587218.639497:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788587218.639545:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bab81f8f800 x1875469208224256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587218.639572:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208224256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788587218.641876:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587218.643189:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224384 00000100:00100000:2.0:1788587218.643212:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224384 00000100:00100000:2.0:1788587218.643302:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788587218.645077:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14470:x1875469208224384:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788587218.656352:0:15133:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788587218.656376:0:15133:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788587218.656383:0:15133:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788587218.680396:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.680415:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.680437:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.680442:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.680450:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.680472:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.680486:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.680495:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.680517:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587218.681087:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.681098:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.681110:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.681138:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.681151:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.681174:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.681182:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8c66869/0xc1a730b05ab89c07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.681278:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.681281:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.681283:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587218.684821:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.684837:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.688322:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.688347:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.688362:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.688417:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.688433:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.688442:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.688478:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587218.694943:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587218.695687:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.695707:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.695727:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.695734:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.695750:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.695781:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.695806:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000624f9d1e/0xc1a730b05ab89c0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.695838:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.695879:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.695881:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.698533:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.698563:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.698570:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.698579:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.698604:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.698632:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.698666:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.701581:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587218.704358:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.704379:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.704403:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.704409:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.704416:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.704434:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.704446:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.704454:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710494:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587218.710516:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710536:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.710542:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710556:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710585:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710595:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c39c1dc/0xc1a730b05ab89c15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710909:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.710916:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710939:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.710943:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710963:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710976:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.710985:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.710987:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.710989:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.711252:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788587218.711263:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587218.714192:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.714213:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.714236:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.714242:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.714250:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.714269:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.714282:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.714291:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.714316:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587218.715911:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587218.715931:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.715957:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587218.715965:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.715978:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.716013:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.716023:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000951b9172/0xc1a730b05ab89c23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.716061:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587218.716064:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587218.716066:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.717278:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587218.719196:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.719219:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.719248:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.719254:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.719286:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.719306:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.719319:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.719329:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.719347:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788587218.720252:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587218.720280:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.720292:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587218.720298:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.720310:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.720336:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.720344:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5ac59c0/0xc1a730b05ab89c2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.720374:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587218.720376:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587218.720378:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788587218.726537:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788587218.727550:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.727566:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.727591:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.727597:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.727606:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.727627:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.727643:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.728275:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.728366:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788587218.729632:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.729645:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.729665:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.729670:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.729678:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.729694:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.729706:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.729715:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.731776:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587218.731801:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.731818:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.731825:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.731839:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.731944:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.732181:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab89c31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.732214:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.732219:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.732226:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.732230:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.732237:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.732249:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.732256:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.732258:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.732261:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.732800:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788587218.732811:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fdea584/0xc1a730b05ab89c38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788587218.734620:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.734636:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.734657:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.734663:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.741118:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.741180:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.741196:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.741205:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.745298:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587218.745323:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.745342:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587218.745348:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.745396:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.745433:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.746161:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.746167:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.746170:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.746639:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788587218.746652:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924fce4b/0xc1a730b05ab89c3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.746754:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788587218.748581:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788587218.748601:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.748636:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1788587218.748642:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587218.748651:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.748669:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.749484:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.749502:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.756193:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587218.756792:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.756807:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.756823:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.756829:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.756881:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.756919:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.756929:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a330045a/0xc1a730b05ab89c46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.756971:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.756974:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.756976:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788587218.762932:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587218.766463:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.766496:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=540s v=(0 0) 00010000:00010000:3.0:1788587218.766503:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587218.766512:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.766536:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.766551:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.766561:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.767621:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587218.768089:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587218.768103:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.768118:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2051600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587218.768136:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.768149:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.768181:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.768190:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d44c383/0xc1a730b05ab89c4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.768222:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.768224:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.768226:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587218.781330:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.781352:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.781397:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1788587218.781403:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.781412:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.781432:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.781445:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.781454:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.781489:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587218.781613:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.781623:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.781632:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.781637:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.781656:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.781679:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.781687:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023d14411/0xc1a730b05ab89c54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.781711:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.781712:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.781714:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587218.788409:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.788431:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.788458:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1788587218.788465:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.788474:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.789178:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.789218:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.789226:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.789302:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587218.790428:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.790443:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.790461:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1788587218.790468:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.790475:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.790491:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.790502:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.790511:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790634:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587218.790647:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790657:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.790663:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790674:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790697:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790718:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8bbfe55/0xc1a730b05ab89c5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790756:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.790760:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790767:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.790770:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790779:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790790:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.790797:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.790799:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.790801:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.791315:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587218.791324:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f58ac9d/0xc1a730b05ab89c62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.791665:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587218.792391:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.792401:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.792418:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1788587218.792424:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.792430:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.792445:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.792456:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.792464:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.792539:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587218.793157:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.793164:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.793182:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1788587218.793186:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.793191:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.793203:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.793211:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.793219:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794036:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587218.794051:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794065:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.794087:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794098:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794133:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794353:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537c304f/0xc1a730b05ab89c69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794388:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.794392:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794399:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4c00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.794403:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794410:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794421:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.794428:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.794435:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.794438:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.794903:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587218.794914:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003df5c465/0xc1a730b05ab89c70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587218.795806:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.795816:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.795833:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=540s v=(0 0) 00010000:00010000:1.0:1788587218.795839:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.795875:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.795904:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.795915:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.795923:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.796258:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.796268:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.796278:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.796284:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.796295:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.796312:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.796320:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.796322:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.796324:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.796399:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587218.796405:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ab1ab3e/0xc1a730b05ab89c77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.797034:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587218.797121:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.797138:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797150:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.797153:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.797158:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797175:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797198:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797205:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797230:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587218.797687:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.797695:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797706:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.797709:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.797714:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797724:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797733:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797741:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.797790:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788587218.797930:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788587218.797939:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.797959:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587218.797965:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.797976:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798008:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798017:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af54bb36/0xc1a730b05ab89c7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798039:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587218.798043:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798050:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5c00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587218.798054:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798062:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798071:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798079:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000848e6996/0xc1a730b05ab89c85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.798091:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.798093:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.798100:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.798546:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587218.799712:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.799726:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.799744:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.799748:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.799754:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.799769:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.799778:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.799786:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.799800:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587218.800207:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587218.800216:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.800226:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587218.800233:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.800244:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.800265:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.800273:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055cbcde2/0xc1a730b05ab89c8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.800298:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.800300:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.800301:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587218.801085:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.801095:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801106:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.801116:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.801132:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801147:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801157:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801165:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801225:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587218.801770:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.801778:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801788:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.801792:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.801797:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801808:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801816:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.801830:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.801977:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587218.801988:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.801997:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.802003:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802029:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802046:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802055:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007748de34/0xc1a730b05ab89c93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802081:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.802084:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802091:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.802094:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802102:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802113:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.802121:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.802133:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.802141:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.802690:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587218.802700:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9c409ed/0xc1a730b05ab89c9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587218.803730:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.803742:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.803759:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.803764:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.803770:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.803785:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.803795:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.803803:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.803941:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587218.804397:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.804404:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.804414:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.804418:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.804422:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.804433:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.804443:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.804451:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.804487:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587218.804497:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.804507:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab4600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.804514:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.804526:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.804527:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.804548:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.804556:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000108604b/0xc1a730b05ab89ca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.804579:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.804581:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.804582:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.804722:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:1.0:1788587218.805348:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.805357:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.805370:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.805380:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.805385:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.805399:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.805408:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.805416:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.805642:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587218.805649:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.805659:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587218.805664:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.805695:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.805711:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587218.805722:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.805724:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587218.805761:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.805770:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbfab5600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587218.805774:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.805781:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.805793:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.805800:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0dfbcbe/0xc1a730b05ab89ca8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587218.805821:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587218.805823:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.806945:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587218.807070:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788587218.807084:0:15133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012b27a62/0xc1a730b05ab89caf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587218.807976:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.807989:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808006:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.808011:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.808019:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808036:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808055:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808064:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808075:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587218.808496:0:15133:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587218.808501:0:15133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808510:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=541s v=(0 0) 00010000:00010000:1.0:1788587218.808514:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587218.808517:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808527:0:15133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808535:0:15133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808542:0:15133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587218.808562:0:15133:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788587218.808879:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587218.808889:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.808898:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2c00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.808904:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.808923:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.808943:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.808951:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfce43a2/0xc1a730b05ab89cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.808978:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587218.808981:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.808988:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587218.808992:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.809000:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.809011:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.809017:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c43308b/0xc1a730b05ab89cbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587218.809094:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.809097:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587218.809099:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587218.809195:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788587218.809417:0:15133:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788587218.809666:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14470:x1875469208224384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 166272us (171232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587218.809687:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788587218.809828:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587218.810563:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14470:1875469208224384:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788587218.810587:0:14470:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788587218.810660:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14470:1875469208224512:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788587218.811097:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587218.811228:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac84cd8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788587218.811314:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224512 00000100:00100000:3.0:1788587218.811324:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224512 00000100:00100000:3.0:1788587218.811448:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587218.811466:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14470:x1875469208224512:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788587218.811541:0:15132:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788587218.823098:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14470:x1875469208224512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11624us (11989us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788587218.823116:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788587218.823186:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14470:1875469208224512:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788587218.823227:0:14470:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788587219.268195:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587220.294661:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587221.320027:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587222.339344:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788587223.048412:0:15849:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788587223.048417:0:15849:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788587223.048546:0:15849:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8bacaf19c000 00000020:01000004:2.0:1788587223.048563:0:15849:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788587223.048577:0:15849:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788587223.048592:0:15849:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8bac90280000) 00000020:00000080:2.0:1788587223.048610:0:15849:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788587223.121327:0:15849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788587223.121627:0:15849:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788587223.125157:0:15849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788587223.125386:0:15849:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788587223.125590:0:15849:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788587223.125976:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 503: rc = 0 00100000:10000000:2.0:1788587223.126083:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 503: rc = 0 00100000:10000000:2.0:1788587223.133388:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 503: rc = 0 00100000:10000000:2.0:1788587223.136987:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 666: rc = 0 00100000:10000000:2.0:1788587223.137265:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 666: rc = 0 00100000:10000000:2.0:1788587223.137519:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 666: rc = 0 00100000:10000000:2.0:1788587223.137766:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 666: rc = 0 00100000:10000000:2.0:1788587223.138056:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 666: rc = 0 00100000:10000000:2.0:1788587223.138279:0:15849:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 666: rc = 0 00000020:00000080:1.0:1788587223.150370:0:15849:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788587223.150384:0:15849:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788587223.150394:0:15849:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1a730b05ab89ccb 00000020:01000004:1.0:1788587223.150401:0:15849:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788587223.150422:0:15849:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.128@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788587223.150425:0:15849:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.128@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788587223.150431:0:15849:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788587223.150450:0:15849:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788587223.150454:0:15849:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.128@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788587223.208246:0:15849:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.128@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788587223.208289:0:15849:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.128@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788587223.208294:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788587223.208296:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587223.208297:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587223.208298:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587223.208300:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587223.208301:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587223.208302:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587223.208304:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587223.208305:0:15849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587223.208310:0:15849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788587223.208313:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788587223.208314:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788587223.208316:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788587223.208317:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788587223.208318:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788587223.208325:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788587223.208326:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788587223.208327:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788587223.208328:0:15849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788587223.208354:0:15849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788587223.208376:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208224640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788587223.208661:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587223.208764:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587223.209870:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224640 00000100:00100000:2.0:1788587223.209882:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224640 00000100:00100000:2.0:1788587223.209940:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587223.209951:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15849:x1875469208224640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788587223.209986:0:14442:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788587223.209990:0:14442:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788587223.209994:0:14442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788587223.223940:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15849:x1875469208224640:12345-0@lo:253:mount.lustre.0 Request processed in 13981us (15269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587223.223956:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788587223.224181:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208224640:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788587223.224196:0:15849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788587223.224199:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788587223.224201:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587223.224202:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587223.224203:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587223.224217:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587223.224219:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587223.224220:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587223.224222:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587223.224223:0:15849:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788587223.224241:0:15849:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8bacaf19c000 from lustre-OST0001 10000000:01000000:2.0:1788587223.224276:0:15849:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788587223.224279:0:15849:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788587223.224287:0:15849:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8bacbf730000 local copy 00010000:00010000:2.0:1788587223.224299:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587223.224591:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208224768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587223.224626:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587223.224725:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac980819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587223.225108:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224768 00000100:00100000:3.0:1788587223.225116:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224768 00000100:00100000:1.0:1788587223.225374:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788587223.225383:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15849:x1875469208224768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587223.225654:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15849:x1875469208224768:12345-0@lo:501:mount.lustre.0 Request processed in 270us (1026us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587223.225663:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788587223.225864:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208224768:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788587223.225882:0:15849:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.128@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788587223.226047:0:15849:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.128@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788587223.226056:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587223.226067:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98200/0xc1a730b05ab89a78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89a7f expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788587223.226095:0:15849:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8bacaf19c000 10000000:01000000:2.0:1788587223.226101:0:15849:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788587223.226106:0:15849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788587223.226108:0:15849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788587223.226112:0:15849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788587223.226115:0:15849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788587223.226141:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4a00/0xc1a730b05ab89cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587223.226156:0:15849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4a00/0xc1a730b05ab89cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587223.226167:0:15849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4a00/0xc1a730b05ab89cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587223.226184:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208224896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788587223.226215:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587223.226248:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac980819c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587223.226469:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208224896 00000100:00100000:1.0:1788587223.226475:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208224896 00000100:00100000:1.0:1788587223.226515:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788587223.226524:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:15849:x1875469208224896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587223.226535:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587223.226548:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbeed3e00/0xc1a730b05ab89cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89cd2 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587223.226570:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbeed3e00/0xc1a730b05ab89cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89cd2 expref: 17 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587223.226582:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbeed3e00/0xc1a730b05ab89cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89cd2 expref: 17 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587223.226602:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed3e00, rc 0) 00000100:00100000:1.0:1788587223.226649:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208224896:12345-0@lo:101:mount.lustre.0 Request processed in 125us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587223.226656:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788587223.226737:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208224896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788587223.226750:0:15849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4a00/0xc1a730b05ab89cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89cd9 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587223.226759:0:15849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4a00/0xc1a730b05ab89cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89cd9 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587223.227712:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788587223.229200:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587223.229556:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788587223.229597:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788587223.229623:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788587223.229667:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788587223.229704:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788587223.229737:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788587223.230015:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788587223.230024:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788587223.230120:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587223.230185:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587223.230227:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90347900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587223.230585:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225024 00000100:00100000:2.0:1788587223.230594:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225024 00000100:00100000:2.0:1788587223.230649:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788587223.230658:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225024:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788587223.231566:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225024:12345-0@lo:501:mount.lustre.0 Request processed in 906us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587223.231575:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788587223.231698:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788587223.231738:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587223.231780:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587223.231819:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90347900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587223.232021:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225152 00000100:00100000:2.0:1788587223.232026:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225152 00000100:00100000:2.0:1788587223.232081:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788587223.232089:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225152:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788587223.232444:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225152:12345-0@lo:503:mount.lustre.0 Request processed in 354us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587223.232450:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788587223.232587:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225152:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788587223.233462:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788587223.233543:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225280:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587223.233600:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587223.233641:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90347900 going to sleep for 11 seconds 00000100:00100000:2.0:1788587223.233960:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225280 00000100:00100000:2.0:1788587223.233967:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225280 00000100:00100000:2.0:1788587223.234014:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788587223.234029:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788587223.234362:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225280:12345-0@lo:502:mount.lustre.0 Request processed in 333us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587223.234369:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788587223.236072:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587223.236445:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788587223.236504:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788587223.236539:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788587223.236583:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788587223.236615:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788587223.236645:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788587223.236687:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788587223.236722:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788587223.236764:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788587223.236976:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587223.237049:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.237125:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587223.237226:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225408 00000100:00100000:3.0:1788587223.237233:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225408 00000100:00100000:3.0:1788587223.237362:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788587223.237372:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587223.237617:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225408:12345-0@lo:502:mount.lustre.0 Request processed in 246us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587223.237625:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788587223.238266:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587223.238363:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788587223.238376:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788587223.239648:0:15851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788587223.239658:0:15851:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788587223.239664:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788587223.239667:0:15851:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788587223.239673:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788587223.239702:0:15851:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8bacbeec99c0) 00000020:00000080:0.0:1788587223.239727:0:15851:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788587223.239734:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788587223.239824:0:15851:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacaf19c000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788587223.239832:0:15851:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788587223.239862:0:15851:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc1a730b05ab89ce7 00010000:00010000:1.0:1788587223.244374:0:15851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788587223.245388:0:15851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788587223.248521:0:15851:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000001:00080000:2.0:1788587223.249072:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788587223.249084:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788587223.250084:0:15851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788587223.250096:0:15851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587223.250102:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.250104:0:15851:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788587223.250108:0:15851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587223.250112:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.250113:0:15851:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788587223.250117:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788587223.250119:0:15851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788587223.250121:0:15851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587223.250123:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.250124:0:15851:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788587223.250126:0:15851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587223.250128:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.250129:0:15851:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788587223.250133:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788587223.250184:0:15851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587223.250187:0:15851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.250189:0:15851:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788587223.250198:0:15851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788587223.250357:0:15849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788587223.250386:0:15849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788587223.250432:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4a00/0xc1a730b05ab89cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89cd9 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.250452:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4a00/0xc1a730b05ab89cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89cd9 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587223.250461:0:15849:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacaf19c000 from 1 10000000:01000000:0.0:1788587223.250464:0:15849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587223.250500:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.250508:0:15849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.250520:0:15849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587223.250544:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587223.250608:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.250653:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587223.250708:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225536 00000100:00100000:1.0:1788587223.250715:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225536 00000100:00100000:1.0:1788587223.250764:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788587223.250773:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:15849:x1875469208225536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788587223.250785:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587223.250807:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89cee expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587223.250831:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587223.250863:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587223.250873:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed2800, rc 0) 00000100:00100000:1.0:1788587223.250909:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208225536:12345-0@lo:101:mount.lustre.0 Request processed in 137us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587223.250916:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788587223.251000:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587223.251014:0:15849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.251024:0:15849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587223.251509:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788587223.251943:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788587223.252203:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788587223.252247:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788587223.252311:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788587223.252319:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788587223.252389:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587223.252440:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.252485:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587223.252509:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225664 00000100:00100000:0.0:1788587223.252515:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225664 00000100:00100000:0.0:1788587223.252566:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587223.252575:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208225664:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587223.252757:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208225664:12345-0@lo:501:mount.lustre.0 Request processed in 182us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587223.252763:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788587223.252804:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788587223.252830:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788587223.252883:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.252903:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587223.252916:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225792 00000100:00100000:0.0:1788587223.252920:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225792 00000100:00100000:0.0:1788587223.252937:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788587223.252942:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208225792:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587223.256738:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208225792:12345-0@lo:503:mount.lustre.0 Request processed in 3785us (3844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587223.256751:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788587223.256952:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225792:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788587223.257484:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788587223.257563:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587223.257614:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.257703:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788587223.257779:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208225920 00000100:00100000:1.0:1788587223.257786:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208225920 00000100:00100000:1.0:1788587223.258015:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788587223.258026:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208225920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587223.258296:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208225920:12345-0@lo:502:mount.lustre.0 Request processed in 271us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587223.258313:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788587223.258377:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208225920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587223.258618:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788587223.258669:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788587223.258716:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788587223.258748:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788587223.258779:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788587223.258873:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788587223.258911:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788587223.258942:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788587223.258972:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587223.259020:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.259063:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788587223.259082:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226048 00000100:00100000:0.0:1788587223.259087:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226048 00000100:00100000:0.0:1788587223.259126:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587223.259133:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208226048:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587223.259268:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208226048:12345-0@lo:502:mount.lustre.0 Request processed in 136us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587223.259275:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788587223.259317:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788587223.259388:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788587223.259397:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788587223.260833:0:15855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587223.260927:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.260931:0:15855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788587223.260937:0:15855:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacaf19c000 00000020:00000080:1.0:1788587223.260939:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587223.260947:0:15855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587223.260949:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.260951:0:15855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788587223.260953:0:15855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587223.260955:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.260956:0:15855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788587223.260959:0:15855:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8bacaf19c000 00000020:00000080:1.0:1788587223.260961:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587223.261015:0:15855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587223.261019:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.261020:0:15855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788587223.261023:0:15855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788587223.261025:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.261026:0:15855:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788587223.261030:0:15855:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8bacaf19c000 00000020:00000080:1.0:1788587223.261032:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788587223.261082:0:15855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788587223.261086:0:15855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788587223.261087:0:15855:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788587223.261090:0:15855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788587223.261400:0:15849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788587223.261432:0:15849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587223.261453:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.261465:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587223.261507:0:15849:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788587223.261510:0:15849:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8bacaf19c000 10000000:01000000:0.0:1788587223.261513:0:15849:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8bacaf19c000 10000000:01000000:0.0:1788587223.261517:0:15849:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788587223.261522:0:15849:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8bacaf19c000 from 1 10000000:01000000:0.0:1788587223.261525:0:15849:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788587223.261558:0:15849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98e00/0xc1a730b05ab89cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.261566:0:15849:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98e00/0xc1a730b05ab89cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.261577:0:15849:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98e00/0xc1a730b05ab89cfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587223.261602:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788587223.261668:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.261710:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587223.261817:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226176 00000100:00100000:2.0:1788587223.261826:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226176 00000100:00100000:2.0:1788587223.261893:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788587223.261901:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208226176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788587223.261914:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587223.261927:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4000/0xc1a730b05ab89d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89cfc expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587223.261951:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4000/0xc1a730b05ab89d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89cfc expref: 19 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587223.261961:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4000/0xc1a730b05ab89d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89cfc expref: 19 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587223.261969:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4000, rc 0) 00000100:00100000:2.0:1788587223.262004:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226176:12345-0@lo:101:mount.lustre.0 Request processed in 104us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587223.262011:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788587223.262161:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788587223.262173:0:15849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98e00/0xc1a730b05ab89cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89d03 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.262182:0:15849:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98e00/0xc1a730b05ab89cfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89d03 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788587223.262823:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788587223.263421:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788587223.263670:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788587223.263712:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788587223.263745:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788587223.263795:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788587223.263833:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788587223.263991:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788587223.264029:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788587223.264077:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788587223.264125:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788587223.264160:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788587223.264191:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788587223.264235:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788587223.264268:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788587223.264374:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788587223.264423:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788587223.264457:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788587223.264489:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788587223.264534:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788587223.264567:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788587223.264598:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788587223.264642:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788587223.264691:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788587223.264723:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788587223.264770:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788587223.264807:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788587223.264919:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788587223.264979:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788587223.265017:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788587223.265061:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788587223.265109:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788587223.265146:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788587223.265184:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788587223.265217:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788587223.265260:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788587223.265390:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788587223.265437:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788587223.265467:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788587223.265561:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788587223.265573:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788587223.265676:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587223.265734:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587223.265780:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226304 00000100:00100000:1.0:1788587223.265787:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226304 00000100:00100000:1.0:1788587223.265832:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587223.265840:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbc80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587223.266055:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbc80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226304:12345-0@lo:501:mount.lustre.0 Request processed in 215us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587223.266064:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788587223.266100:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831f00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587223.266120:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788587223.266148:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788587223.266180:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587223.266194:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831f00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587223.267913:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226432 00000100:00100000:3.0:1788587223.267924:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226432 00000100:00100000:3.0:1788587223.267975:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788587223.267983:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788587223.268305:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226432:12345-0@lo:503:mount.lustre.0 Request processed in 321us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587223.268313:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788587223.268538:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788587223.269169:0:15849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788587223.269242:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587223.269295:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587223.269383:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac908c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587223.271002:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226560 00000100:00100000:0.0:1788587223.271499:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226560 00000100:00100000:0.0:1788587223.271617:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788587223.271630:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788587223.272087:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226560:12345-0@lo:502:mount.lustre.0 Request processed in 458us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587223.272096:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788587223.272175:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788587223.272441:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788587223.272497:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788587223.272530:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788587223.272579:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788587223.272615:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788587223.272663:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788587223.272698:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788587223.272730:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788587223.272791:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788587223.272826:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788587223.272882:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788587223.272981:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788587223.273048:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788587223.273086:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788587223.273135:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788587223.273168:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788587223.273198:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788587223.273258:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788587223.273293:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788587223.273323:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788587223.273369:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788587223.273400:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788587223.273427:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788587223.273466:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788587223.273511:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788587223.273539:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788587223.273581:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788587223.273611:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788587223.273639:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788587223.273680:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788587223.273714:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788587223.273751:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788587223.273782:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788587223.274518:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788587223.274575:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788587223.274623:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788587223.274659:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788587223.274688:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788587223.274732:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788587223.275159:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788587223.275214:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788587223.278673:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587223.278740:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac908c36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587223.279504:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226688 00000100:00100000:3.0:1788587223.279515:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226688 00000100:00100000:3.0:1788587223.279573:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788587223.279582:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788587223.279908:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208226688:12345-0@lo:502:mount.lustre.0 Request processed in 327us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587223.279917:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788587223.279932:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b81880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208226688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788587223.280141:0:15849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788587223.280158:0:15849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788587223.281607:0:15860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788587223.281622:0:15860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8bac90284d40) 00000020:00000080:2.0:1788587223.281643:0:15860:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788587223.281727:0:15860:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8bacaf19c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788587223.281735:0:15860:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8bacaf19c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788587223.281737:0:15860:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8bacaf19c000 3 00010000:00080000:2.0:1788587223.281839:0:15860:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8bab81fde000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.128@tcp at head 00010000:00010000:3.0:1788587223.283825:0:15860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788587223.284083:0:15860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788587223.284122:0:15860:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788587223.284136:0:15860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc1a730b05ab89d11 00000100:00080000:3.0:1788587223.284147:0:15860:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788587223.284153:0:15860:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8bab81fde000 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1788587223.284193:0:15860:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab81f8d180 x1875469208226816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788587223.284218:0:15860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788587223.285011:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788587223.285016:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788587223.285019:0:36:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788587223.285025:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:0.0:1788587223.285030:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788587223.285052:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bab81226800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:0.0:1788587223.285071:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bacbf353480 x1875469208227072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587223.285184:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208226944:0@lo:400:kworker.0 00000100:00100000:0.0:1788587223.285245:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208227200:0@lo:400:kworker.0 00000100:00100000:3.0:1788587223.285259:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.285273:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587223.285341:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226944 00000100:00100000:1.0:1788587223.285349:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226944 00000100:00080000:3.0:1788587223.285411:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788587223.285422:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788587223.285434:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208226944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587223.285519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208226816:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788587223.285563:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587223.285569:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208227328:0@lo:400:kworker.0 00000100:00100000:0.0:1788587223.285592:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.285623:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227200 00000100:00100000:0.0:1788587223.285626:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227200 00000100:00100000:0.0:1788587223.285651:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227328 00000100:00100000:0.0:1788587223.285654:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227328 00000100:00100000:0.0:1788587223.285696:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587223.285703:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208227200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587223.285740:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208227200:12345-0@lo:400:kworker.0 Request processed in 37us (465us total) trans 0 rc 0/0 00000100:00080000:3.0:1788587223.285744:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587223.285746:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788587223.285761:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587223.285767:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208227328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587223.285795:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208227328:12345-0@lo:400:kworker.0 Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587223.285814:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788587223.285874:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbf351f80 x1875469208227328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587223.285889:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208227328:0@lo:400:kworker.0 00010000:00080000:0.0:1788587223.285900:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bacbf352a00 x1875469208227200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788587223.285908:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208227200:0@lo:400:kworker.0 00000100:00100000:1.0:1788587223.286433:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208226944:12345-0@lo:400:kworker.0 Request processed in 1000us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587223.286443:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587223.287635:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788587223.287661:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208226944:0@lo:400:kworker.0 00000100:00100000:2.0:1788587223.288419:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587223.288508:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208227072:0@lo:8:kworker.0 00000100:00100000:2.0:1788587223.288541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587223.288582:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227072 00000100:00100000:2.0:1788587223.288588:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227072 00000100:00100000:2.0:1788587223.288620:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587223.288627:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875469208227072:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788587223.288679:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875469208227072:12345-0@lo:8:kworker.0 Request processed in 51us (136us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788587223.288686:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788587223.288713:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587223.288719:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788587223.288723:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788587223.288726:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208227072:0@lo:8:kworker.0 00000040:00080000:2.0:1788587223.289211:0:15860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788587223.290160:0:15849:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788587223.290196:0:15849:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788587223.290219:0:15849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98e00/0xc1a730b05ab89cfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89d03 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587223.290230:0:15849:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98e00/0xc1a730b05ab89cfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89d03 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788587223.290274:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788587223.290280:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587223.290282:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587223.290283:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587223.290284:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587223.290285:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587223.290286:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587223.290288:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587223.290289:0:15849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587223.290293:0:15849:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788587223.290295:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788587223.290296:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788587223.290297:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788587223.290298:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788587223.290299:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788587223.290300:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788587223.290301:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788587223.290302:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788587223.290303:0:15849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788587223.290329:0:15849:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788587223.290348:0:15849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208227456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788587223.290410:0:15849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587223.290443:0:15849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bacb44fd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587223.290912:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208226816 00000100:00100000:0.0:1788587223.290920:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208226816 00000100:00100000:0.0:1788587223.290958:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587223.290966:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875469208226816:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788587223.290988:0:14448:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 545 last 0 00000020:00000080:0.0:1788587223.291021:0:14448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc1a730b05ab89d18 00000004:00100000:0.0:1788587223.291050:0:14448:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788587223.291082:0:14448:0:(import.c:65:import_set_state_nolock()) ffff8bac90398800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587223.291138:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875469208226816:12345-0@lo:38:llog_process_th.0 Request processed in 171us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587223.291151:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587223.291174:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227456 00000100:00100000:0.0:1788587223.291177:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227456 00000100:00100000:0.0:1788587223.291203:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788587223.291209:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:15849:x1875469208227456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788587223.291228:0:14441:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788587223.291243:0:14441:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788587223.291474:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8bab81f8d180 x1875469208226816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788587233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587223.291486:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788587223.291495:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788587223.291502:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788587223.291507:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788587223.291510:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81fde000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788587223.291515:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875469208226816:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788587223.316216:0:14441:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788587223.316230:0:14441:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788587223.316266:0:14463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788587223.316271:0:14463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788587223.316293:0:14463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316312:0:14463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 19 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316321:0:14463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316362:0:14463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 19 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316377:0:14463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 19 pid: 14441 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587223.316393:0:14463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14463:1875469208227584:0@lo:104: 00000100:00100000:0.0:1788587223.316459:0:14463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.316499:0:14463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac9ec9c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587223.316524:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227584 00000100:00100000:0.0:1788587223.316543:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227584 00000100:00100000:0.0:1788587223.316589:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587223.316599:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14463:x1875469208227584:12345-0@lo:104: 00010000:00010000:0.0:1788587223.316612:0:14431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316662:0:14431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788587223.316668:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:14463:x1875469208227584:12345-0@lo:104: Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587223.316676:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788587223.316699:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587223.316704:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316711:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4e00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:0.0:1788587223.316715:0:15661:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316724:0:15661:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788587223.316732:0:15661:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587223.316737:0:15661:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788587223.316764:0:15661:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316770:0:15661:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788587223.316786:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316798:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4e00/0xc1a730b05ab89bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89bf9 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.316812:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587223.316814:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587223.316815:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587223.316828:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587223.316838:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208227712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788587223.316898:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587223.316937:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227712 00000100:00100000:0.0:1788587223.316942:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227712 00010000:00010000:0.0:1788587223.316958:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 20 pid: 14441 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587223.316978:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587223.316984:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+20:3315:x1875469208227712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587223.316993:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587223.316997:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 20 pid: 14441 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317007:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 20 pid: 14441 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317024:0:14432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317033:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788587223.317156:0:14432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002092551s 00010000:00010000:0.0:1788587223.317163:0:14432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317170:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317176:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317182:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317187:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587223.317191:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317199:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317208:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317218:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587223.317247:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+20:3315:x1875469208227712:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587223.317254:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587223.317298:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208227712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788587223.317326:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab89bf2 expref: 19 pid: 14441 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587223.317344:0:14463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14463:1875469208227584:0@lo:104: 00010000:00010000:0.0:1788587223.317357:0:14463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317365:0:14463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317371:0:14463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587223.317376:0:14463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a99000/0xc1a730b05ab89d1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587223.326695:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:15849:x1875469208227456:12345-0@lo:253:mount.lustre.0 Request processed in 35477us (36276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587223.326711:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788587223.326961:0:15849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7044063-f08f-49f3-baab-c8410dd7f9cc:15849:1875469208227456:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788587223.326976:0:15849:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788587223.326979:0:15849:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788587223.326981:0:15849:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788587223.326982:0:15849:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788587223.326983:0:15849:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788587223.326984:0:15849:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788587223.326985:0:15849:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788587223.326986:0:15849:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788587223.326988:0:15849:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788587223.326989:0:15849:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788587223.327079:0:15849:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788587223.331597:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587223.331967:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587223.332153:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587223.332368:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788587223.332527:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788587223.332737:0:15849:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788587223.333265:0:15849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1788587223.363105:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788587223.374275:0:15849:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788587223.374284:0:15849:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788587223.374336:0:15849:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788587223.374429:0:15849:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.128@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788587223.374445:0:15849:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788587223.374477:0:15849:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1788587224.068102:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587224.068128:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208227840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587224.068210:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587224.068395:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227840 00000100:00100000:3.0:1788587224.068407:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227840 00000100:00100000:3.0:1788587224.068501:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587224.068510:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208227840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587224.068549:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587224.068628:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208227840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587224.068636:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587224.068759:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208227840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788587224.396454:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788587224.964123:0:14444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788587224.964132:0:14444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8bac82bbc800 from 8 10000000:01000000:0.0:1788587224.964138:0:14444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788587224.964191:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98c00/0xc1a730b05ab89d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587224.964203:0:14444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98c00/0xc1a730b05ab89d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587224.964214:0:14444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98c00/0xc1a730b05ab89d26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587224.964241:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208227968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587224.964309:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587224.964363:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac84cd8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788587224.964432:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208227968 00000100:00100000:3.0:1788587224.964440:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208227968 00000100:00100000:3.0:1788587224.964494:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587224.964503:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:14444:x1875469208227968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587224.964516:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587224.964531:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab89d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89d26 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587224.964554:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab89d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89d26 expref: 19 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587224.964565:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050400/0xc1a730b05ab89d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89d26 expref: 19 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587224.964575:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050400, rc 0) 00000100:00100000:3.0:1788587224.964621:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208227968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587224.964628:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788587224.964673:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208227968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587224.964687:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98c00/0xc1a730b05ab89d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89d2d expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587224.964712:0:14444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98c00/0xc1a730b05ab89d26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89d2d expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587224.964764:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208228096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788587224.964795:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587224.964810:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac880d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587224.964824:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228096 00000100:00100000:3.0:1788587224.964827:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228096 00000100:00100000:0.0:1788587224.964926:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788587224.964935:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208228096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788587224.964951:0:14439:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788587224.964966:0:14439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788587224.964969:0:14439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788587224.965054:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208228096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587224.965061:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788587224.973228:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208228096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788587224.973312:0:14444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788587224.973323:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98c00/0xc1a730b05ab89d26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89d2d expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587224.973332:0:14444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a98c00/0xc1a730b05ab89d26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89d2d expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587225.425035:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788587225.993345:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788587226.436640:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587227.463506:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.483207:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788587228.675113:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788587228.675120:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788587228.675124:0:38:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788587228.675154:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8bab81226800 using connection 192.168.204.128@tcp/0@lo 00000100:00100000:3.0:1788587228.675177:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8bab81f8f100 x1875469208228480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788587228.675239:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208228224:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.675322:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587228.675387:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208228864:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.675417:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587228.675442:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587228.675447:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208228352:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.675468:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587228.675508:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208228480:0@lo:8:kworker.0 00000100:00100000:3.0:1788587228.675530:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587228.675554:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208228608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.675575:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587228.675591:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788587228.675596:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208228736:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.675616:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587228.675644:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228224 00000100:00100000:3.0:1788587228.675651:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228224 00000100:00100000:3.0:1788587228.675707:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788587228.675717:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3312:x1875469208228224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.675766:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3312:x1875469208228224:12345-0@lo:400:kworker.0 Request processed in 51us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587228.675773:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788587228.675807:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228864 00000100:00100000:3.0:1788587228.675810:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228864 00000100:00100000:3.0:1788587228.675839:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228608 00000100:00100000:3.0:1788587228.675871:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228608 00000100:00100000:3.0:1788587228.675884:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228736 00000100:00100000:3.0:1788587228.675887:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228736 00000100:00100000:3.0:1788587228.675901:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587228.675906:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208228864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.675965:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208228864:12345-0@lo:400:kworker.0 Request processed in 59us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587228.675972:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788587228.675985:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587228.675991:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208228608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.676021:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208228608:12345-0@lo:400:kworker.0 Request processed in 32us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587228.676027:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587228.676037:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587228.676043:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208228736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.676067:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208228736:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587228.676072:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587228.676088:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228352 00000100:00100000:3.0:1788587228.676092:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228352 00000100:00100000:3.0:1788587228.676117:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228480 00000100:00100000:3.0:1788587228.676119:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228480 00000100:00100000:3.0:1788587228.676130:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587228.676136:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208228352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.676162:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208228352:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587228.676167:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587228.676177:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587228.676181:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875469208228480:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788587228.676202:0:15132:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1788587228.676229:0:15132:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc1a730b05ab89d34 00002000:00100000:3.0:1788587228.676248:0:15132:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8bacbbc37000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788587228.676252:0:15132:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788587228.676255:0:15132:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788587228.676604:0:15132:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788587228.676630:0:15132:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc36000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587228.676671:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875469208228480:12345-0@lo:8:kworker.0 Request processed in 488us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587228.676678:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788587228.676706:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587228.676711:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788587228.676744:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bab81f8f100 x1875469208228480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788587253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788587228.676760:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788587228.676768:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788587228.676774:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788587228.676776:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8bab81226800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788587228.676788:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788587228.676793:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875469208228480:0@lo:8:kworker.0 00010000:00080000:3.0:1788587228.676823:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bab81f8ce00 x1875469208228736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587228.676831:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208228736:0@lo:400:kworker.0 00010000:00080000:3.0:1788587228.676863:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bab81f8fb80 x1875469208228608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587228.676872:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208228608:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.676900:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208228352:0@lo:400:kworker.0 00000100:00100000:3.0:1788587228.676919:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208228224:0@lo:400:kworker.0 00010000:00080000:3.0:1788587228.676929:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bab81f8d180 x1875469208228864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788587228.676954:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208228864:0@lo:400:kworker.0 00000004:00080000:1.0:1788587228.677702:0:14472:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788587228.677727:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b81180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14472:1875469208229120:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788587228.677772:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587228.677796:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac883c8300 going to sleep for 11 seconds 00000004:00080000:1.0:1788587228.677814:0:14471:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788587228.678559:0:14471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 550882714617ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788587228.678588:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208228992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587228.678625:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587228.678671:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208228992 00000100:00100000:1.0:1788587228.678679:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208228992 00000100:00100000:1.0:1788587228.678747:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788587228.678756:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875469208228992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788587228.678791:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587228.678836:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875469208228992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587228.678877:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788587228.678901:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788587228.678927:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bacb5b81880 x1875469208228992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788587244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788587228.678959:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208228992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788587228.678989:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208229120 00000100:00100000:1.0:1788587228.678993:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208229120 00000100:00100000:1.0:1788587228.679019:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587228.679024:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14472:x1875469208229120:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788587228.690347:0:15132:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788587228.690362:0:15132:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788587228.690371:0:15132:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1788587228.727416:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.727432:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727451:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.727455:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.727463:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727498:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727511:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727532:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727555:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.727571:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.727577:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727585:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2c00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.727589:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727599:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727617:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727625:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.727644:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.727646:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.727648:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.728252:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.728267:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728278:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.728281:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.728285:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728295:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728304:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728311:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728328:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.728339:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.728343:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728350:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.728354:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728362:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728379:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728387:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728400:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.728401:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.728403:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.728779:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.728785:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728794:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.728798:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.728802:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728811:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728820:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728827:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728885:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.728896:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.728901:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728907:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.728910:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728919:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728930:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728954:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.728969:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.728971:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.728972:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.729373:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.729380:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729389:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.729397:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.729401:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729412:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729419:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729426:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729441:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.729449:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.729454:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729461:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.729464:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729473:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729483:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729501:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.729517:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.729519:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.729521:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.741928:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.741954:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.741972:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.741978:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.741984:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742001:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742013:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742022:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742041:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.742054:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.742067:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742074:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.742079:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742088:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742106:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742114:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89d57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742134:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.742136:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.742138:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.742806:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.742814:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742824:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.742827:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.742831:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742886:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742894:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742900:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742930:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.742956:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.742961:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742968:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.742972:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742980:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.742992:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.743000:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.743020:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.743022:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.743024:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.745380:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.745393:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745407:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.745410:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.745416:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745429:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745439:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745447:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745464:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.745475:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.745496:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745517:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.745522:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745537:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745552:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745560:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89d65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.745576:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.745578:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.745580:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.746028:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.746035:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746045:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.746048:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.746053:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746065:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746080:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746087:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746102:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.746111:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.746115:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746122:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.746126:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746133:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746143:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746149:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89d6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.746162:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.746171:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.746173:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.748216:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.748227:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748244:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.748248:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.748255:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748269:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748281:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748289:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748315:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.748333:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.748339:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748346:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.748351:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748377:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748392:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748400:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.748419:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.748422:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.748423:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.750519:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.752922:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.752957:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.752962:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.752970:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.752988:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753000:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753024:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753063:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.753077:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.753083:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753091:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2c00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.753095:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753105:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753122:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753130:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.753153:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.753155:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.753157:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.759124:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.761692:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.761717:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.761722:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.761728:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.761745:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.761758:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.761766:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.764432:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.764460:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.764469:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.764483:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.764487:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.764500:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.764534:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.764542:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.764570:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.764572:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.764574:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.765237:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.765245:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.765258:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.765263:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.765269:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769284:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769311:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769320:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769800:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.769817:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.769824:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769833:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.769839:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769893:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769915:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769924:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89d88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.769959:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.769962:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.769966:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.773779:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.773792:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.773809:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.773820:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.773829:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.773874:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.773887:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.773895:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.773911:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587228.774353:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587228.774363:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.774375:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2c00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587228.774381:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.774391:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.774413:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.774421:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfce43a2/0xc1a730b05ab89d8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.774564:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.774567:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.774569:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.775626:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.775796:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.775892:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.775897:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.775903:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.775918:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.775943:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.775958:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.775978:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587228.775982:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587228.775989:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.776007:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2600 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587228.776012:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.776021:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.776037:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.776122:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c43308b/0xc1a730b05ab89d96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.776140:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.776142:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.776143:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.780104:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.780119:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.781983:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.781990:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.781999:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782019:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782031:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782038:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782475:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788587228.782507:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.782514:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782920:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.782926:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782951:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782971:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.782978:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89d9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.783001:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.783002:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.783004:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.787063:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.787076:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787094:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.787098:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.787105:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787119:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787157:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787165:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787187:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587228.787246:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587228.787254:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.787276:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587228.787281:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.787292:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.787310:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.787319:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012b27a62/0xc1a730b05ab89da4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.787340:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.787342:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.787344:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.787793:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.787800:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787809:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=550s v=(0 0) 00010000:00010000:1.0:1788587228.787812:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.787816:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787827:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.787835:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.789420:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.789654:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587228.789712:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587228.789720:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.789728:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587228.789733:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.789744:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.789769:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.789776:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e30b1086/0xc1a730b05ab89dab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.789794:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.789796:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.789797:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587228.796376:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587228.796388:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.796404:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1788587228.796409:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587228.796416:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.796430:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.796441:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.796450:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.797309:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587228.797318:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.797328:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587228.797333:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.797343:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.797365:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.797372:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.797374:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.797376:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.797535:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788587228.797542:0:15132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002551b406/0xc1a730b05ab89db2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788587228.798544:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587228.798553:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.798567:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1788587228.798570:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587228.798576:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.798589:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.798598:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.798605:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.798626:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00100000:3.0:1788587228.798817:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788587228.805217:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587228.805232:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.805245:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99a00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587228.805251:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.805263:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.805293:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.805301:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000769f2972/0xc1a730b05ab89db9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.805328:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.805330:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.805332:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587228.813256:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587228.813271:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813296:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1788587228.813301:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587228.813309:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813325:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813336:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813344:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813363:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788587228.813378:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587228.813383:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813390:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587228.813395:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813404:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813433:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813441:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000670e41b1/0xc1a730b05ab89dc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.813460:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.813462:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.813464:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788587228.819891:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788587228.819906:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.819927:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=551s v=(0 0) 00010000:00010000:0.0:1788587228.819943:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587228.819950:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.819966:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.819978:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.819986:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.820024:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788587228.820051:0:15661:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788587228.820060:0:15661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.820068:0:15661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99000 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:2.0:1788587228.820073:0:15661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.820083:0:15661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.820100:0:15661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.820108:0:15661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061e1129c/0xc1a730b05ab89dc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587228.820202:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.820204:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.820206:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788587228.822043:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788587228.832078:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.832093:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832112:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788587228.832117:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.832124:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832153:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832164:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832173:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832202:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587228.832654:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.832660:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832669:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788587228.832672:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.832677:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832687:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832696:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832714:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.832730:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788587228.832873:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587228.832881:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.832893:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587228.832899:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.832909:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.832997:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587228.833003:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.833012:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587228.833015:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.833024:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.833041:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.833049:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070b5bc7c/0xc1a730b05ab89dd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.833065:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.833066:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.833068:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788587228.833273:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.833279:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833289:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788587228.833292:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.833297:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833306:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833314:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833321:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833336:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587228.833761:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788587228.833766:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833768:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.833780:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000994c17f4/0xc1a730b05ab89dce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833789:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788587228.833794:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.833799:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.833803:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587228.833809:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.833815:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.833840:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587228.833869:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.833878:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.833890:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.833897:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007df50b0/0xc1a730b05ab89ddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587228.833910:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587228.833912:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587228.833914:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.834667:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587228.836311:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.836337:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.836359:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788587228.837346:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.837354:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.837368:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788587228.837373:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.837379:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.837393:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.837414:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.837420:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.837439:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788587228.838275:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.838284:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.838296:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788587228.838299:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.838304:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.838315:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.838323:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.838331:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.838363:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788587228.839159:0:15132:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788587228.839167:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.839178:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=551s v=(0 0) 00010000:00010000:1.0:1788587228.839182:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587228.839186:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.839198:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.839207:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.839214:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587228.839225:0:15132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:1.0:1788587228.839621:0:15132:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1788587228.839725:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14472:x1875469208229120:12345-0@lo:5:osp-pre-1-0.0 Request processed in 160694us (161946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587228.839737:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788587228.839815:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b81180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14472:1875469208229120:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788587228.840374:0:14472:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788587228.840439:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b81180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14472:1875469208229248:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788587228.840485:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788587228.840501:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788587228.840512:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840524:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3400 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587228.840536:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840553:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840577:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840584:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000685eb720/0xc1a730b05ab89de3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840605:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1788587228.840609:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac831c3c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788587228.840610:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840619:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2e00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587228.840623:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840631:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587228.840632:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208229248 00000100:00100000:1.0:1788587228.840640:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208229248 00010000:00010000:0.0:1788587228.840645:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840654:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964f7e73/0xc1a730b05ab89dea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840675:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788587228.840679:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840685:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3600 already unused, calling callback (ffffffffc14994f0) 00000100:00100000:1.0:1788587228.840690:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788587228.840691:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587228.840703:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14472:x1875469208229248:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1788587228.840703:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840721:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840729:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015704451/0xc1a730b05ab89df1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840742:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788587228.840746:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788587228.840750:0:15133:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788587228.840758:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587228.840761:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840781:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840793:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840801:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f19dced9/0xc1a730b05ab89df8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587228.840817:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.840819:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587228.840821:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.841668:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788587228.842645:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587228.845509:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14472:x1875469208229248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4801us (5016us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788587228.845523:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788587228.845670:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b81180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14472:1875469208229248:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788587228.845691:0:14472:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788587229.191672:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208229376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788587229.191749:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587229.191872:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208229376 00000100:00100000:0.0:1788587229.191882:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208229376 00000100:00100000:0.0:1788587229.191951:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788587229.191961:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208229376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587229.192001:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587229.196562:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208229376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4589us (4799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587229.196577:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788587229.196884:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208229376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788587229.510723:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587230.535361:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788587231.084476:0:16206:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg428-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788587231.559963:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587232.581777:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587233.608269:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587233.796979:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208229504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587233.797063:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587233.797138:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208229504 00000100:00100000:0.0:1788587233.797146:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208229504 00000100:00100000:0.0:1788587233.797203:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788587233.797212:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875469208229504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587233.797247:0:15135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587233.797294:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875469208229504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587233.797300:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788587233.797322:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587233.797357:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208229504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587233.798319:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208229760:0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798369:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587233.798397:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788587233.798402:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7044063-f08f-49f3-baab-c8410dd7f9cc:3313:1875469208229632:0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798428:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587233.798453:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208230144:0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798480:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587233.798513:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230144 00000100:00100000:2.0:1788587233.798518:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230144 00000100:00100000:2.0:1788587233.798570:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587233.798579:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208230144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798638:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875469208230144:12345-0@lo:400:kworker.0 Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587233.798645:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788587233.798669:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208229888:0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798711:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587233.798743:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587233.798749:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208230016:0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798770:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587233.798794:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208229888 00000100:00100000:2.0:1788587233.798798:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208229888 00000100:00100000:2.0:1788587233.798817:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230016 00000100:00100000:2.0:1788587233.798820:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230016 00000100:00100000:2.0:1788587233.798866:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587233.798874:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208229888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798908:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208229888:12345-0@lo:400:kworker.0 Request processed in 36us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587233.798915:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788587233.798927:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788587233.798932:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208230016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.798956:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208230016:12345-0@lo:400:kworker.0 Request processed in 25us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587233.798961:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788587233.798984:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788587233.799010:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bab829eca80 x1875469208230016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587233.799023:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208230016:0@lo:400:kworker.0 00010000:00080000:2.0:1788587233.799033:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bab829ee300 x1875469208229888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587233.799042:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208229888:0@lo:400:kworker.0 00010000:00080000:2.0:1788587233.799086:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8bab829ec380 x1875469208230144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788587249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788587233.799095:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875469208230144:0@lo:400:kworker.0 00000100:00100000:0.0:1788587233.799829:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208229760 00000100:00100000:0.0:1788587233.799879:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208229760 00000100:00100000:0.0:1788587233.799941:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788587233.799950:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208229760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587233.800007:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208229760:12345-0@lo:400:kworker.0 Request processed in 58us (1637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587233.800019:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788587233.802066:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587233.802125:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208229760:0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.804023:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208229632 00000100:00100000:2.0:1788587233.804039:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208229632 00000100:00100000:2.0:1788587233.804103:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587233.804114:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3313:x1875469208229632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587233.804207:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3313:x1875469208229632:12345-0@lo:400:kworker.0 Request processed in 95us (5777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587233.804214:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788587233.804271:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7044063-f08f-49f3-baab-c8410dd7f9cc:3313:1875469208229632:0@lo:400:kworker.0 00000100:00100000:1.0:1788587233.840434:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587233.840510:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182019968 00000100:00100000:3.0:1788587233.840521:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182019968 00000100:00100000:3.0:1788587233.840582:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:3.0:1788587233.840590:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875469182019968:12345-192.168.204.28@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788587233.840627:0:14442:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from aa5bf23d-9321-44c0-a194-3dd88f5eaaa3@192.168.204.28@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:3.0:1788587233.840658:0:14442:0:(genops.c:1385:class_connect()) connect: client aa5bf23d-9321-44c0-a194-3dd88f5eaaa3, cookie 0xc1a730b05ab89dff 00000100:00080000:3.0:1788587233.840830:0:14442:0:(import.c:65:import_set_state_nolock()) ffff8bacbbc34800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788587233.840947:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+5:2358:x1875469182019968:12345-192.168.204.28@tcp:250:mount.lustre.0 Request processed in 356us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587233.840968:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 74 00000100:00100000:2.0:1788587233.878444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587233.879229:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020096 00000100:00100000:3.0:1788587233.879242:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020096 00000100:00100000:3.0:1788587233.879301:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:3.0:1788587233.879310:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+5:13763:x1875469182020096:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788587233.879328:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587233.879345:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b02 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587233.879372:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b02 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587233.879384:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050e00/0xc1a730b05ab89e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b02 expref: 6 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587233.879394:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050e00, rc 0) 00000100:00100000:3.0:1788587233.879454:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+6:13763:x1875469182020096:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 145us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587233.879461:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 75 00000100:00100000:2.0:1788587233.907259:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587233.908305:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020224 00000100:00100000:1.0:1788587233.908317:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020224 00000100:00100000:1.0:1788587233.908372:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:1.0:1788587233.908382:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+6:13763:x1875469182020224:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788587233.913107:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+6:13763:x1875469182020224:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 4714us (5847us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788587233.913122:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 76 00000100:00100000:0.0:1788587233.937396:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587233.937439:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020352 00000100:00100000:0.0:1788587233.937449:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020352 00000100:00100000:0.0:1788587233.937498:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:0.0:1788587233.937508:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+6:13763:x1875469182020352:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788587233.937522:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587233.937540:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a99a00/0xc1a730b05ab89e0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b09 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587233.937584:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a99a00/0xc1a730b05ab89e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b09 expref: 7 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587233.937595:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a99a00/0xc1a730b05ab89e0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b09 expref: 7 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587233.937604:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99a00, rc 0) 00000100:00100000:0.0:1788587233.937649:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+7:13763:x1875469182020352:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 143us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587233.937656:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 77 00000100:00100000:0.0:1788587233.946922:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587233.947003:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020480 00000100:00100000:1.0:1788587233.947012:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020480 00000100:00100000:1.0:1788587233.947064:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:1.0:1788587233.947083:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+7:13763:x1875469182020480:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788587233.947396:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13763:x1875469182020480:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 313us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587233.947404:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 78 00000100:00100000:2.0:1788587233.955402:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587233.955528:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020608 00000100:00100000:1.0:1788587233.955551:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020608 00000100:00100000:1.0:1788587233.955608:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:1.0:1788587233.955617:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13763:x1875469182020608:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587233.955827:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4f84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13763:x1875469182020608:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 209us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587233.955882:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 79 00000100:00100000:2.0:1788587233.967305:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587233.971968:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020736 00000100:00100000:0.0:1788587233.971985:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020736 00000100:00100000:0.0:1788587233.972071:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 80 00000100:00100000:0.0:1788587233.972081:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13782:x1875469182020736:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788587233.972388:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13782:x1875469182020736:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 308us (5098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587233.972396:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 80 00000001:00080000:3.0:1788587233.979449:0:7665:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1788587233.990734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587233.990901:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020864 00000100:00100000:3.0:1788587233.990912:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020864 00000100:00100000:3.0:1788587233.990967:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:3.0:1788587233.990977:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13782:x1875469182020864:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587233.991262:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13782:x1875469182020864:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 285us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587233.991280:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 81 00000100:00100000:3.0:1788587234.012285:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587234.015701:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182020992 00000100:00100000:2.0:1788587234.015718:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182020992 00000100:00100000:2.0:1788587234.015782:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:2.0:1788587234.015792:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+8:13763:x1875469182020992:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587234.015808:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587234.015827:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b33 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.015918:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b33 expref: 9 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.015931:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d5a00/0xc1a730b05ab89e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b33 expref: 9 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.015941:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5a00, rc 0) 00000100:00100000:2.0:1788587234.015999:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+9:13763:x1875469182020992:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 209us (3728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587234.016006:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 82 00000100:00100000:2.0:1788587234.036687:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587234.036799:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182021120 00000100:00100000:0.0:1788587234.036810:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182021120 00000100:00100000:0.0:1788587234.036909:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:0.0:1788587234.036919:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+9:13763:x1875469182021120:12345-192.168.204.28@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788587234.036944:0:14442:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788587234.036968:0:14442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788587234.036976:0:14442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788587234.036980:0:14442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788587234.036982:0:14442:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788587234.038926:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+9:13763:x1875469182021120:12345-192.168.204.28@tcp:256:mount.lustre.0 Request processed in 1997us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587234.038939:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 83 00000100:00100000:3.0:1788587234.043930:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587234.044039:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182021248 00000100:00100000:1.0:1788587234.044050:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182021248 00000100:00100000:1.0:1788587234.044113:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:1.0:1788587234.044123:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+9:13763:x1875469182021248:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788587234.044139:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587234.044158:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b3a expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587234.044188:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587234.044201:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587234.044223:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed3000, rc 0) 00000100:00100000:1.0:1788587234.044293:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13763:x1875469182021248:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 171us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587234.044301:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 84 00000100:00100000:2.0:1788587234.048775:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587234.048942:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182021376 00000100:00100000:3.0:1788587234.048957:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182021376 00000100:00100000:3.0:1788587234.049023:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:3.0:1788587234.049033:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13763:x1875469182021376:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788587234.049474:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13763:x1875469182021376:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 441us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587234.049483:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 85 00000100:00100000:0.0:1788587234.067915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587234.068043:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182021504 00000100:00100000:2.0:1788587234.068053:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182021504 00000100:00100000:2.0:1788587234.068135:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:2.0:1788587234.068145:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13763:x1875469182021504:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587234.068378:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13763:x1875469182021504:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 233us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587234.068386:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 86 00000100:00100000:3.0:1788587234.071659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587234.071893:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182021632 00000100:00100000:1.0:1788587234.071904:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182021632 00000100:00100000:1.0:1788587234.071965:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:1.0:1788587234.071977:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13787:x1875469182021632:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587234.072399:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13787:x1875469182021632:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 423us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587234.072407:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 87 00000100:00100000:0.0:1788587234.077560:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587234.077749:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182021760 00000100:00100000:2.0:1788587234.077759:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182021760 00000100:00100000:2.0:1788587234.077820:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:2.0:1788587234.077841:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13787:x1875469182021760:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788587234.078177:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13787:x1875469182021760:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 345us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587234.078195:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 88 00000100:00100000:0.0:1788587234.103431:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587234.107078:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182021888 00000100:00100000:2.0:1788587234.107110:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182021888 00000100:00100000:2.0:1788587234.107186:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1788587234.107196:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875469182021888:12345-192.168.204.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587234.107229:0:14449:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f609c3a5-c4ee-4a91-8ffd-01bcb8479d45@192.168.204.28@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:2.0:1788587234.107278:0:14449:0:(genops.c:1385:class_connect()) connect: client f609c3a5-c4ee-4a91-8ffd-01bcb8479d45, cookie 0xc1a730b05ab89e22 00000004:00100000:2.0:1788587234.107312:0:14449:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788587234.107318:0:14449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788587234.167308:0:14449:0:(import.c:65:import_set_state_nolock()) ffff8bac9039a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587234.167399:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2358:x1875469182021888:12345-192.168.204.28@tcp:38:mount.lustre.0 Request processed in 60201us (63976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587234.167411:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:3.0:1788587234.171227:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587234.171268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587234.171446:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022016 00000100:00100000:0.0:1788587234.171457:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022016 00000100:00100000:0.0:1788587234.171542:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022144 00000100:00100000:0.0:1788587234.171546:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022144 00000100:00100000:0.0:1788587234.171565:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:0.0:1788587234.171574:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:0:x1875469182022016:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587234.171631:0:14448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587234.171716:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:0:x1875469182022016:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 143us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587234.171724:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:0.0:1788587234.171743:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:0.0:1788587234.171750:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13763:x1875469182022144:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788587234.171761:0:14448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587234.171782:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13763:x1875469182022144:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 34us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587234.171789:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00080000:3.0:1788587234.172053:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587234.180254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587234.182905:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022272 00000100:00100000:1.0:1788587234.182925:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022272 00000100:00100000:1.0:1788587234.183009:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1788587234.183020:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13763:x1875469182022272:12345-192.168.204.28@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788587234.183121:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13763:x1875469182022272:12345-192.168.204.28@tcp:40:mount.lustre.0 Request processed in 103us (2879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587234.183128:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:0.0:1788587234.190392:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587234.190433:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587234.190461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587234.190495:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022400 00000100:00100000:0.0:1788587234.190507:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022400 00000100:00100000:0.0:1788587234.190540:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022528 00000100:00100000:0.0:1788587234.190543:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022528 00000100:00100000:0.0:1788587234.190569:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:0.0:1788587234.190578:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875469182022400:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788587234.190616:0:15132:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f609c3a5-c4ee-4a91-8ffd-01bcb8479d45@192.168.204.28@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1788587234.190653:0:15132:0:(genops.c:1385:class_connect()) connect: client f609c3a5-c4ee-4a91-8ffd-01bcb8479d45, cookie 0xc1a730b05ab89e29 00002000:00100000:0.0:1788587234.190666:0:15132:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f609c3a5-c4ee-4a91-8ffd-01bcb8479d45/ffff8bac8f08c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788587234.190691:0:15132:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788587234.191068:0:15132:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788587234.191100:0:15132:0:(import.c:65:import_set_state_nolock()) ffff8bac8f08b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587234.191168:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2358:x1875469182022400:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 588us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587234.191176:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:0.0:1788587234.191196:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1788587234.191201:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875469182022528:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788587234.191217:0:15132:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f609c3a5-c4ee-4a91-8ffd-01bcb8479d45@192.168.204.28@tcp t0 exp 0000000000000000 cur 556 last 0 00000020:00000080:0.0:1788587234.191234:0:15132:0:(genops.c:1385:class_connect()) connect: client f609c3a5-c4ee-4a91-8ffd-01bcb8479d45, cookie 0xc1a730b05ab89e30 00002000:00100000:0.0:1788587234.191240:0:15132:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f609c3a5-c4ee-4a91-8ffd-01bcb8479d45/ffff8bac8f08d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788587234.191247:0:15132:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788587234.191454:0:15132:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788587234.191483:0:15132:0:(import.c:65:import_set_state_nolock()) ffff8bac8f08e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788587234.191506:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2358:x1875469182022528:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 303us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587234.191513:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1788587234.192258:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022656 00000100:00100000:3.0:1788587234.192267:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022656 00000100:00100000:3.0:1788587234.192316:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:3.0:1788587234.192324:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13763:x1875469182022656:12345-192.168.204.28@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788587234.196315:0:14450:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3930us 00000004:00200000:3.0:1788587234.240398:0:14450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788587234.240549:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13763:x1875469182022656:12345-192.168.204.28@tcp:33:mount.lustre.0 Request processed in 48208us (50150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587234.240562:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1788587234.310349:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587234.310378:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208230272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587234.310452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587234.310538:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230272 00000100:00100000:1.0:1788587234.310547:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230272 00000100:00100000:1.0:1788587234.310599:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587234.310610:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208230272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587234.310653:0:15135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587234.310699:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208230272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587234.310706:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788587234.310767:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208230272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587234.463375:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587234.463485:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022784 00000100:00100000:2.0:1788587234.463495:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022784 00000100:00100000:2.0:1788587234.463568:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1788587234.463580:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13808:x1875469182022784:12345-192.168.204.28@tcp:101:mkdir.0 00010000:00010000:2.0:1788587234.463601:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587234.463628:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b64 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.463691:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89e3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.463704:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.463719:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587234.463754:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788587234.463773:0:14447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587234.463815:0:14447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89e3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.463882:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab89e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b64 expref: 8 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.463901:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89e3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b64 expref: 7 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587234.463921:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:2.0:1788587234.463924:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587234.463927:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4400, rc 0) 00000100:00100000:2.0:1788587234.463989:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:13808:x1875469182022784:12345-192.168.204.28@tcp:101:mkdir.0 Request processed in 412us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587234.463997:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00010000:00010000:1.0:1788587234.627035:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788587235.203537:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788587235.651354:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587236.651941:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587236.652186:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182022912 00000100:00100000:0.0:1788587236.652208:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182022912 00000100:00100000:0.0:1788587236.652286:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1788587236.652298:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:13861:x1875469182022912:12345-192.168.204.28@tcp:41:lfs.0 00000004:00000024:0.0:1788587236.652346:0:14448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788587236.652450:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:13861:x1875469182022912:12345-192.168.204.28@tcp:41:lfs.0 Request processed in 154us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587236.652457:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00080000:3.0:1788587236.653643:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587236.657217:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.657324:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023040 00000100:00100000:1.0:1788587236.657336:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023040 00000100:00100000:1.0:1788587236.657424:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:1.0:1788587236.657437:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13861:x1875469182023040:12345-192.168.204.28@tcp:13:lfs.0 00002000:00000024:1.0:1788587236.657480:0:15135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587236.657583:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13861:x1875469182023040:12345-192.168.204.28@tcp:13:lfs.0 Request processed in 147us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.657590:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00080000:3.0:1788587236.658170:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587236.668252:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.669762:0:15135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023168 00000100:00100000:1.0:1788587236.669776:0:15135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023168 00000100:00100000:1.0:1788587236.669973:0:15135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1788587236.669986:0:15135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13861:x1875469182023168:12345-192.168.204.28@tcp:13:lfs.0 00002000:00000024:1.0:1788587236.670026:0:15135:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587236.670133:0:15135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:13861:x1875469182023168:12345-192.168.204.28@tcp:13:lfs.0 Request processed in 150us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.670140:0:15135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00080000:3.0:1788587236.671318:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788587236.683913:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587236.807964:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587236.808282:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023296 00000100:00100000:3.0:1788587236.808303:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023296 00000100:00100000:3.0:1788587236.808374:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00100000:3.0:1788587236.808387:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+10:13891:x1875469182023296:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788587236.808409:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587236.808430:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab89e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b6b expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587236.808464:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab89e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b6b expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587236.808478:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2051600/0xc1a730b05ab89e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b6b expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587236.808488:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051600, rc 0) 00000100:00100000:3.0:1788587236.808591:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13891:x1875469182023296:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 206us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587236.808598:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 89 00000100:00100000:2.0:1788587236.816772:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.816873:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023424 00000100:00100000:1.0:1788587236.816885:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023424 00000100:00100000:1.0:1788587236.816950:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:1.0:1788587236.816982:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13891:x1875469182023424:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788587236.817325:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13891:x1875469182023424:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 343us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.817333:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 90 00000100:00100000:0.0:1788587236.824011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587236.824172:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023552 00000100:00100000:2.0:1788587236.824183:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023552 00000100:00100000:2.0:1788587236.824249:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:2.0:1788587236.824259:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13891:x1875469182023552:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788587236.824537:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13891:x1875469182023552:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 279us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587236.824545:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 91 00000100:00100000:2.0:1788587236.833694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.833823:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023680 00000100:00100000:1.0:1788587236.833834:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023680 00000100:00100000:1.0:1788587236.834050:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:1.0:1788587236.834064:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13898:x1875469182023680:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587236.834378:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13898:x1875469182023680:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 316us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.834387:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 92 00000100:00100000:1.0:1788587236.859543:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587236.859956:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023808 00000100:00100000:3.0:1788587236.859966:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023808 00000100:00100000:3.0:1788587236.860021:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:3.0:1788587236.860031:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13898:x1875469182023808:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788587236.861015:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13898:x1875469182023808:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 693us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587236.861034:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 93 00000100:00100000:0.0:1788587236.879600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587236.880063:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182023936 00000100:00100000:2.0:1788587236.880077:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182023936 00000100:00100000:2.0:1788587236.880375:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:2.0:1788587236.880390:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13891:x1875469182023936:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587236.880420:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587236.880443:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab89e4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b95 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587236.880471:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab89e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b95 expref: 12 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587236.880483:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4e00/0xc1a730b05ab89e4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b95 expref: 12 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587236.880492:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4e00, rc 0) 00000100:00100000:2.0:1788587236.880566:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13891:x1875469182023936:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 179us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587236.880573:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 94 00000100:00100000:2.0:1788587236.891793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587236.891888:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024064 00000100:00100000:3.0:1788587236.891899:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024064 00000100:00100000:3.0:1788587236.891955:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:3.0:1788587236.891965:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb238d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13891:x1875469182024064:12345-192.168.204.28@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788587236.892001:0:14439:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788587236.892028:0:14439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788587236.892032:0:14439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788587236.892035:0:14439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788587236.892037:0:14439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788587236.897185:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb238d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13891:x1875469182024064:12345-192.168.204.28@tcp:256:mount.lustre.0 Request processed in 5210us (5614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.897200:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 95 00000100:00100000:0.0:1788587236.904415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587236.913150:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024192 00000100:00100000:2.0:1788587236.913167:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024192 00000100:00100000:2.0:1788587236.913237:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:2.0:1788587236.913248:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13891:x1875469182024192:12345-192.168.204.28@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788587236.913266:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587236.913297:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2b9c expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587236.913348:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 13 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587236.913359:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 13 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587236.913369:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4600, rc 0) 00000100:00100000:2.0:1788587236.913447:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13891:x1875469182024192:12345-192.168.204.28@tcp:101:mount.lustre.0 Request processed in 200us (9046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587236.913454:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 96 00000100:00100000:2.0:1788587236.921036:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.923166:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024320 00000100:00100000:1.0:1788587236.923180:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024320 00000100:00100000:1.0:1788587236.923376:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:1.0:1788587236.923389:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13891:x1875469182024320:12345-192.168.204.28@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788587236.923765:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13891:x1875469182024320:12345-192.168.204.28@tcp:501:mount.lustre.0 Request processed in 377us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.923773:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 97 00000100:00100000:3.0:1788587236.933620:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.934058:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024448 00000100:00100000:1.0:1788587236.934070:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024448 00000100:00100000:1.0:1788587236.934137:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:1.0:1788587236.934167:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13891:x1875469182024448:12345-192.168.204.28@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788587236.934446:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13891:x1875469182024448:12345-192.168.204.28@tcp:503:mount.lustre.0 Request processed in 281us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.934457:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 98 00000100:00100000:0.0:1788587236.945169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.945347:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024576 00000100:00100000:1.0:1788587236.945359:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024576 00000100:00100000:1.0:1788587236.945435:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:1.0:1788587236.945446:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13905:x1875469182024576:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587236.945755:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13905:x1875469182024576:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 309us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.945764:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 99 00000100:00100000:0.0:1788587236.955430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.955675:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024704 00000100:00100000:1.0:1788587236.955688:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024704 00000100:00100000:1.0:1788587236.955757:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:1.0:1788587236.955769:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13905:x1875469182024704:12345-192.168.204.28@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788587236.956103:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13905:x1875469182024704:12345-192.168.204.28@tcp:502:llog_process_th.0 Request processed in 335us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.956112:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 100 00000100:00100000:3.0:1788587236.960798:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587236.960948:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587236.961580:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587236.961621:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.961929:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025472 00000100:00100000:1.0:1788587236.961941:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025472 00000100:00100000:1.0:1788587236.962017:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025344 00000100:00100000:1.0:1788587236.962022:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025344 00000100:00100000:1.0:1788587236.962041:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:1.0:1788587236.962051:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2361:x1875469182025472:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587236.962138:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2361:x1875469182025472:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 87us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.962164:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:1.0:1788587236.962182:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1788587236.962189:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2361:x1875469182025344:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587236.962216:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2361:x1875469182025344:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.962222:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:2.0:1788587236.963902:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024832 00000100:00100000:2.0:1788587236.963916:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024832 00000100:00100000:2.0:1788587236.963977:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025216 00000100:00100000:2.0:1788587236.963982:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025216 00000100:00100000:2.0:1788587236.964010:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1788587236.964019:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2361:x1875469182025216:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587236.964099:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2361:x1875469182025216:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 81us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587236.964106:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:2.0:1788587236.964124:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1788587236.964129:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875469182024832:12345-192.168.204.28@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788587236.964151:0:14447:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35b9e3bf-ee50-43fc-85f3-0213efdb22be@192.168.204.28@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788587236.964189:0:14447:0:(genops.c:1385:class_connect()) connect: client 35b9e3bf-ee50-43fc-85f3-0213efdb22be, cookie 0xc1a730b05ab89e5a 00000004:00100000:2.0:1788587236.964221:0:14447:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788587236.964377:0:14447:0:(import.c:65:import_set_state_nolock()) ffff8bab81fdd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587236.964409:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2358:x1875469182024832:12345-192.168.204.28@tcp:38:mount.lustre.0 Request processed in 279us (3634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587236.964417:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:3.0:1788587236.967887:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587236.967929:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.968166:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025088 00000100:00100000:1.0:1788587236.968179:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025088 00000100:00100000:1.0:1788587236.968244:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182024960 00000100:00100000:1.0:1788587236.968247:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182024960 00000100:00100000:1.0:1788587236.968263:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1788587236.968273:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+7:13891:x1875469182025088:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587236.968335:0:14449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587236.968422:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+7:13891:x1875469182025088:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 149us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.968430:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1788587236.968449:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788587236.968456:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:0:x1875469182024960:12345-192.168.204.28@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788587236.968468:0:14449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788587236.968490:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:0:x1875469182024960:12345-192.168.204.28@tcp:41:mount.lustre.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.968499:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00080000:0.0:1788587236.969196:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587236.974413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587236.974591:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025600 00000100:00100000:1.0:1788587236.974601:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025600 00000100:00100000:1.0:1788587236.975276:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1788587236.975292:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab81f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:13891:x1875469182025600:12345-192.168.204.28@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788587236.975406:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab81f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:13891:x1875469182025600:12345-192.168.204.28@tcp:40:mount.lustre.0 Request processed in 120us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587236.975414:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1788587236.980146:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587236.980265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587236.980304:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587236.980335:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025728 00000100:00100000:2.0:1788587236.980354:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025728 00000100:00100000:2.0:1788587236.980395:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025856 00000100:00100000:2.0:1788587236.980398:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025856 00000100:00100000:2.0:1788587236.980412:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1788587236.980421:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875469182025728:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587236.980464:0:15133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 35b9e3bf-ee50-43fc-85f3-0213efdb22be@192.168.204.28@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788587236.980503:0:15133:0:(genops.c:1385:class_connect()) connect: client 35b9e3bf-ee50-43fc-85f3-0213efdb22be, cookie 0xc1a730b05ab89e61 00002000:00100000:2.0:1788587236.980516:0:15133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35b9e3bf-ee50-43fc-85f3-0213efdb22be/ffff8bab81fdc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587236.980528:0:15133:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587236.980662:0:15133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788587236.980695:0:15133:0:(import.c:65:import_set_state_nolock()) ffff8bab81fd8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587236.980768:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2358:x1875469182025728:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 347us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587236.980789:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:2.0:1788587236.980806:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:2.0:1788587236.980810:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875469182025856:12345-192.168.204.28@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788587236.980825:0:15133:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 35b9e3bf-ee50-43fc-85f3-0213efdb22be@192.168.204.28@tcp t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:2.0:1788587236.980887:0:15133:0:(genops.c:1385:class_connect()) connect: client 35b9e3bf-ee50-43fc-85f3-0213efdb22be, cookie 0xc1a730b05ab89e68 00002000:00100000:2.0:1788587236.980892:0:15133:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35b9e3bf-ee50-43fc-85f3-0213efdb22be/ffff8bab81fd9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788587236.980900:0:15133:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788587236.980978:0:15133:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788587236.980994:0:15133:0:(import.c:65:import_set_state_nolock()) ffff8bab81fd8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788587236.981031:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2358:x1875469182025856:12345-192.168.204.28@tcp:8:mount.lustre.0 Request processed in 218us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587236.981037:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1788587236.990403:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182025984 00000100:00100000:0.0:1788587236.990419:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182025984 00000100:00100000:0.0:1788587236.990485:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:0.0:1788587236.990496:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:13891:x1875469182025984:12345-192.168.204.28@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788587236.990601:0:14451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788587236.990703:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:13891:x1875469182025984:12345-192.168.204.28@tcp:33:mount.lustre.0 Request processed in 209us (10568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587236.990711:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:3.0:1788587237.270261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587237.270592:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182026112 00000100:00100000:0.0:1788587237.270603:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182026112 00000100:00100000:0.0:1788587237.270669:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:0.0:1788587237.270680:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:13926:x1875469182026112:12345-192.168.204.28@tcp:101:mkdir.0 00010000:00010000:0.0:1788587237.270712:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587237.270735:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab89e6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2bc6 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587237.270811:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587237.270825:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587237.270872:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587237.270922:0:14448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587237.270926:0:14448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587237.270946:0:14448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587237.270970:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab89e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 8 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587237.270989:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 7 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587237.270998:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:0.0:1788587237.271001:0:14448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587237.271020:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587237.271083:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+7:13926:x1875469182026112:12345-192.168.204.28@tcp:101:mkdir.0 Request processed in 405us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587237.271091:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00010000:00010000:1.0:1788587237.700771:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788587238.514917:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f609c3a5-c4ee-4a91-8ffd-01bcb8479d45 00000001:00100000:3.0:1788587238.514940:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35b9e3bf-ee50-43fc-85f3-0213efdb22be 00010000:00010000:0.0:1788587238.729101:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587238.916239:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208230400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587238.916353:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587238.916548:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208230912:0@lo:400:kworker.0 00000100:00100000:2.0:1788587238.916578:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587238.916884:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208230656:0@lo:400:kworker.0 00000100:00100000:1.0:1788587238.916963:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587238.917002:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788587238.917009:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208230784:0@lo:400:kworker.0 00000100:00100000:1.0:1788587238.917037:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587238.917074:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230912 00000100:00100000:1.0:1788587238.917084:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230912 00000100:00100000:1.0:1788587238.917149:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230784 00000100:00100000:1.0:1788587238.917152:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230784 00000100:00100000:2.0:1788587238.917159:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788587238.917175:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208230528:0@lo:400:kworker.0 00000100:00100000:2.0:1788587238.917226:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587238.917259:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208231040:0@lo:400:kworker.0 00000100:00100000:2.0:1788587238.917283:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587238.917325:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230528 00000100:00100000:2.0:1788587238.917331:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230528 00000100:00100000:2.0:1788587238.917382:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587238.917393:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3314:x1875469208230528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587238.917456:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3314:x1875469208230528:12345-0@lo:400:kworker.0 Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587238.917464:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788587238.917520:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208230528:0@lo:400:kworker.0 00000100:00100000:0.0:1788587238.917786:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230400 00000100:00100000:0.0:1788587238.917791:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230400 00000100:00100000:0.0:1788587238.917862:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587238.917872:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208230400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587238.917920:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587238.917968:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208230400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587238.917975:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788587238.917994:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231040 00000100:00100000:0.0:1788587238.917998:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231040 00000100:00100000:0.0:1788587238.918022:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587238.918029:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208230912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587238.918064:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875469208230912:12345-0@lo:400:kworker.0 Request processed in 35us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587238.918070:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587238.918084:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587238.918091:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208230784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587238.918126:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208230784:12345-0@lo:400:kworker.0 Request processed in 36us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587238.918132:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587238.918142:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788587238.918148:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208231040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587238.918181:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875469208231040:12345-0@lo:400:kworker.0 Request processed in 35us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587238.918187:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788587238.918203:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587238.918209:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587238.918240:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208230784:0@lo:400:kworker.0 00000100:00100000:0.0:1788587238.918273:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875469208231040:0@lo:400:kworker.0 00000100:00100000:0.0:1788587238.918286:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875469208230912:0@lo:400:kworker.0 00000100:00100000:0.0:1788587238.918296:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788587238.918325:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208230400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587238.923324:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208230656 00000100:00100000:3.0:1788587238.923335:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208230656 00000100:00100000:3.0:1788587238.923408:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587238.923419:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208230656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587238.923526:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208230656:12345-0@lo:400:kworker.0 Request processed in 109us (6563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587238.923546:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788587238.924641:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587238.924707:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208230656:0@lo:400:kworker.0 00000001:00100000:1.0:1788587239.027684:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f609c3a5-c4ee-4a91-8ffd-01bcb8479d45 00000001:00100000:1.0:1788587239.027712:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35b9e3bf-ee50-43fc-85f3-0213efdb22be 00000100:00100000:3.0:1788587239.447661:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208231168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788587239.447747:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587239.448956:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231168 00000100:00100000:3.0:1788587239.448966:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231168 00000100:00100000:3.0:1788587239.449017:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587239.449027:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208231168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587239.449063:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587239.449126:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208231168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587239.449133:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788587239.449187:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208231168:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788587239.602175:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f609c3a5-c4ee-4a91-8ffd-01bcb8479d45 00000001:00100000:3.0:1788587239.602203:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35b9e3bf-ee50-43fc-85f3-0213efdb22be 00010000:00010000:3.0:1788587239.761654:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587240.771009:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788587241.812157:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587242.016660:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587242.016719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587242.016896:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182026368 00000100:00100000:0.0:1788587242.016924:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182026368 00000100:00100000:0.0:1788587242.017030:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1788587242.017045:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2359:x1875469182026368:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587242.017162:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2359:x1875469182026368:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 121us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587242.017170:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:3.0:1788587242.017589:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182026240 00000100:00100000:3.0:1788587242.017600:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182026240 00000100:00080000:1.0:1788587242.017745:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587242.018744:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:3.0:1788587242.018763:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2359:x1875469182026240:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587242.018858:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2359:x1875469182026240:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 87us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587242.018865:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 102 00000100:00100000:1.0:1788587242.025956:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587242.026114:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587242.040918:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587242.040967:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587242.041089:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182026752 00000100:00100000:1.0:1788587242.041105:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182026752 00000100:00100000:1.0:1788587242.041191:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:1.0:1788587242.041202:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2359:x1875469182026752:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587242.041299:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2359:x1875469182026752:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 100us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587242.041306:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00080000:1.0:1788587242.042824:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788587242.054596:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182026624 00000100:00100000:3.0:1788587242.054622:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182026624 00000100:00100000:3.0:1788587242.054731:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1788587242.054742:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2359:x1875469182026624:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587242.056198:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2359:x1875469182026624:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 1451us (30078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587242.056209:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:3.0:1788587242.056241:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182026880 00000100:00100000:3.0:1788587242.056247:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182026880 00000100:00100000:3.0:1788587242.056277:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:3.0:1788587242.056285:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182026880:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587242.056327:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182026880:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 43us (15371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587242.056333:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00080000:3.0:1788587242.056363:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788587242.056368:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587242.056501:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587242.059702:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027008 00000100:00100000:3.0:1788587242.059718:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027008 00000100:00080000:0.0:1788587242.059808:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587242.059811:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788587242.059826:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182027008:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:3.0:1788587242.060234:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182027008:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 408us (3740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587242.060243:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:2.0:1788587242.076743:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182026496 00000100:00100000:2.0:1788587242.076759:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182026496 00000100:00100000:3.0:1788587242.076960:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1788587242.076971:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2360:x1875469182026496:12345-192.168.204.28@tcp:400:kworker.0 00000100:00080000:2.0:1788587242.079327:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587242.095029:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2360:x1875469182026496:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 18048us (69070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587242.095062:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000001:02000400:3.0:1788587242.417718:0:16414:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788587242.840403:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587243.844248:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587244.035363:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208231296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587244.035462:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587244.035573:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231296 00000100:00100000:3.0:1788587244.035582:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231296 00000100:00100000:3.0:1788587244.035654:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788587244.035665:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208231296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587244.035701:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587244.035751:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208231296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587244.035758:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788587244.035802:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788587244.036146:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208231296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587244.043148:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208231680:0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.043235:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587244.043285:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788587244.043292:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208231808:0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.043316:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587244.043350:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231680 00000100:00100000:0.0:1788587244.043358:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231680 00000100:00100000:0.0:1788587244.043414:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231808 00000100:00100000:0.0:1788587244.043417:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231808 00000100:00100000:0.0:1788587244.043445:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587244.043453:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208231680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.043505:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875469208231680:12345-0@lo:400:kworker.0 Request processed in 52us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587244.043512:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788587244.043530:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788587244.043537:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208231808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.043565:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208231808:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587244.043572:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788587244.043595:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587244.043626:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208231808:0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.043650:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875469208231680:0@lo:400:kworker.0 00000100:00100000:3.0:1788587244.043988:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208231552:0@lo:400:kworker.0 00000100:00100000:3.0:1788587244.044025:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587244.044055:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788587244.044061:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208231424:0@lo:400:kworker.0 00000100:00100000:3.0:1788587244.044087:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587244.044108:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208231936:0@lo:400:kworker.0 00000100:00100000:3.0:1788587244.044128:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587244.044533:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231424 00000100:00100000:1.0:1788587244.044540:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231424 00000100:00100000:1.0:1788587244.044584:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788587244.044592:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3315:x1875469208231424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587244.044647:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3315:x1875469208231424:12345-0@lo:400:kworker.0 Request processed in 48us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587244.044654:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788587244.044695:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7044063-f08f-49f3-baab-c8410dd7f9cc:3315:1875469208231424:0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.045507:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231552 00000100:00100000:0.0:1788587244.045516:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231552 00000100:00100000:0.0:1788587244.045572:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587244.045580:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208231552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.045636:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208231552:12345-0@lo:400:kworker.0 Request processed in 57us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587244.045666:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788587244.045698:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208231552:0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.045718:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208231936 00000100:00100000:0.0:1788587244.045721:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208231936 00000100:00100000:0.0:1788587244.045747:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587244.045754:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208231936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587244.045786:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875469208231936:12345-0@lo:400:kworker.0 Request processed in 33us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587244.045792:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788587244.045815:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875469208231936:0@lo:400:kworker.0 00000100:00080000:3.0:1788587244.046262:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788587244.046266:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587244.566241:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788587244.566266:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208232064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587244.566335:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587244.566405:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208232064 00000100:00100000:0.0:1788587244.566412:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208232064 00000100:00100000:0.0:1788587244.566462:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587244.566471:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208232064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788587244.566506:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587244.566554:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208232064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587244.566561:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788587244.566609:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208232064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788587244.868535:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788587245.443799:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788587245.893954:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587246.915884:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587247.121237:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587247.121272:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587247.121304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587247.121366:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587247.121395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587247.121413:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587247.121439:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587247.121463:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027520 00000100:00100000:0.0:1788587247.121473:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027520 00000100:00100000:0.0:1788587247.121537:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027776 00000100:00100000:0.0:1788587247.121540:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027776 00000100:00100000:0.0:1788587247.121552:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027392 00000100:00100000:0.0:1788587247.121555:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027392 00000100:00100000:0.0:1788587247.121566:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027904 00000100:00100000:0.0:1788587247.121568:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027904 00000100:00100000:0.0:1788587247.121596:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1788587247.121606:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2359:x1875469182027520:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587247.121677:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2359:x1875469182027520:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 72us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587247.121684:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1788587247.121700:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1788587247.121707:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182027776:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587247.121731:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182027776:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587247.121737:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1788587247.121754:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1788587247.121760:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2359:x1875469182027392:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587247.121781:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2359:x1875469182027392:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587247.121798:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1788587247.121809:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:1.0:1788587247.121811:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027264 00000100:00100000:1.0:1788587247.121815:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027264 00000100:00100000:0.0:1788587247.121815:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182027904:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587247.121838:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2359:x1875469182027904:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 23us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587247.121858:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027648 00000100:00100000:1.0:1788587247.121861:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027648 00000100:00100000:0.0:1788587247.121865:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:1.0:1788587247.121877:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:0.0:1788587247.121881:0:14447:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788587247.121884:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2359:x1875469182027264:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587247.121888:0:14447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1788587247.121903:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587247.121908:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788587247.121909:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587247.121911:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2359:x1875469182027264:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 29us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587247.121916:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1788587247.121927:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:1.0:1788587247.121940:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2359:x1875469182027648:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587247.121962:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2359:x1875469182027648:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587247.121969:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:0.0:1788587247.122076:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182027136 00000100:00100000:0.0:1788587247.122081:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182027136 00000100:00100000:0.0:1788587247.122106:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 104 00000100:00100000:0.0:1788587247.122112:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2359:x1875469182027136:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587247.122140:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2359:x1875469182027136:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587247.122146:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 104 00010000:00010000:2.0:1788587247.945177:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788587248.093969:0:16563:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2b5be880 20000000:00000080:1.0:1788587248.093992:0:16563:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8bab81e91000 uarg=0000000000000000 20000000:01000000:1.0:1788587248.094103:0:16563:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788587248.094109:0:16563:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788587248.094114:0:16563:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788587248.095243:0:16564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788587248.095735:0:16563:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788587248.110096:0:16563:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788587248.110143:0:16563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110170:0:16563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110178:0:16563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 18 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110184:0:16563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110193:0:16563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110199:0:16563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 12 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110206:0:16563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110760:0:16563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 12 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.110777:0:16563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 12 pid: 14441 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587248.110793:0:16563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232192:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587248.112743:0:16563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 12 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.112765:0:16563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 12 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.112863:0:16563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232320:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587248.112951:0:16563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.112961:0:16563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 18 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.112970:0:16563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232448:0@lo:104: 00000100:00100000:2.0:1788587248.113010:0:16563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587248.113057:0:16563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 18 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.113065:0:16563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 18 pid: 14442 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.113073:0:16563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232576:0@lo:104: 00000100:00100000:2.0:1788587248.113096:0:16563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788587248.113142:0:16563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.113151:0:16563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 18 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.113285:0:16563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232704:0@lo:104: 00000100:00100000:2.0:1788587248.113315:0:16563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587248.113327:0:16563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac881fa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788587248.116342:0:14431:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788587248.116391:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208232448 00000100:00100000:3.0:1788587248.116402:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208232448 00000100:00100000:3.0:1788587248.116456:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208232576 00000100:00100000:3.0:1788587248.116459:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208232576 00000100:00100000:3.0:1788587248.116470:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208232704 00000100:00100000:3.0:1788587248.116473:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208232704 00000100:00100000:3.0:1788587248.116488:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587248.116497:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+5:16563:x1875469208232448:12345-0@lo:104: 00010000:00010000:3.0:1788587248.116516:0:14431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.116626:0:14431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788587248.116632:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+5:16563:x1875469208232448:12345-0@lo:104: Request processed in 137us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587248.116640:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587248.116658:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587248.116665:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+4:16563:x1875469208232576:12345-0@lo:104: 00010000:00010000:3.0:1788587248.116673:0:14431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.116713:0:14431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788587248.116718:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+4:16563:x1875469208232576:12345-0@lo:104: Request processed in 55us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587248.116725:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587248.116738:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587248.116744:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac882f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:16563:x1875469208232704:12345-0@lo:104: 00010000:00010000:3.0:1788587248.116753:0:14431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.116799:0:14431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788587248.116804:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac882f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7044063-f08f-49f3-baab-c8410dd7f9cc+3:16563:x1875469208232704:12345-0@lo:104: Request processed in 61us (3489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587248.116811:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788587248.116903:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788587248.116909:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.116916:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc1a99600 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587248.116920:0:14435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.116929:0:14435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587248.116936:0:14435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587248.116942:0:14435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587248.116978:0:14435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.116984:0:14435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587248.117004:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117010:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99600/0xc1a730b05ab89cee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89cf5 expref: -99 pid: 15849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117034:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788587248.117037:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117043:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5e00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587248.117045:0:14435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117052:0:14435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587248.117059:0:14435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587248.117064:0:14435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587248.117078:0:14435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117083:0:14435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587248.117090:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117097:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d5e00/0xc1a730b05ab89bba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89bc1 expref: -99 pid: 15129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117106:0:14435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788587248.117109:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117124:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4c00 already unused, calling callback (ffffffffc1ab6c20) 10000000:00010000:3.0:1788587248.117127:0:14435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117133:0:14435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788587248.117139:0:14435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788587248.117144:0:14435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788587248.117157:0:14435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117161:0:14435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788587248.117177:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117183:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89b6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc1a730b05ab89b74 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117196:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587248.117197:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587248.117199:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788587248.117206:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587248.117227:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208232832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587248.117264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587248.117304:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788587248.117310:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208232960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587248.117339:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587248.117368:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208233088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587248.117391:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587248.117421:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208232832 00000100:00100000:3.0:1788587248.117425:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208232832 00010000:00010000:3.0:1788587248.117445:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 19 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587248.117461:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208232960 00000100:00100000:3.0:1788587248.117463:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208232960 00010000:00010000:3.0:1788587248.117474:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 20 pid: 14442 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587248.117483:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233088 00000100:00100000:3.0:1788587248.117486:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233088 00010000:00010000:3.0:1788587248.117495:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 21 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587248.117507:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587248.117513:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+21:3312:x1875469208232832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587248.117522:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587248.117527:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 21 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117536:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 21 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117553:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587248.117595:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+21:3312:x1875469208232832:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587248.117610:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788587248.117624:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587248.117629:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+20:3312:x1875469208232960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587248.117636:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587248.117640:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 20 pid: 14442 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117647:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 20 pid: 14442 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117657:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587248.117677:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+20:3312:x1875469208232960:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587248.117682:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788587248.117694:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587248.117700:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3314:x1875469208233088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788587248.117707:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587248.117711:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 19 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117717:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 19 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.117726:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587248.117750:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3314:x1875469208233088:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587248.117756:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788587248.117812:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7044063-f08f-49f3-baab-c8410dd7f9cc:3314:1875469208233088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587248.117868:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208232960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788587248.117877:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208232832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788587248.118585:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbeed2800/0xc1a730b05ab89cf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab89cee expref: 18 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.118599:0:16563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232448:0@lo:104: 00010000:00010000:2.0:1788587248.118610:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbfab5800/0xc1a730b05ab89bc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab89bba expref: 17 pid: 14442 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.118618:0:16563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232576:0@lo:104: 00010000:00010000:2.0:1788587248.118627:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacc1a99800/0xc1a730b05ab89b74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc1a730b05ab89b6d expref: 16 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.118635:0:16563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232704:0@lo:104: 00010000:00010000:1.0:1788587248.118996:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587248.124040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587248.124098:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028032 00000100:00100000:2.0:1788587248.124109:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028032 00010000:00010000:2.0:1788587248.124168:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 13 pid: 14441 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587248.124205:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:2.0:1788587248.129048:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2361:x1875469182028032:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587248.129092:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587248.129103:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 13 pid: 14441 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.129120:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 13 pid: 14441 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.129723:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587248.129800:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2361:x1875469182028032:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5584us (5775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587248.129811:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00010000:00010000:1.0:1788587248.131694:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbf9d4600/0xc1a730b05ab89e53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b9c expref: 12 pid: 14441 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587248.131716:0:16563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232192:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587248.137061:0:16563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16563:1875469208232320:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587248.137107:0:16563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587248.140888:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587248.140993:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028160 00000100:00100000:3.0:1788587248.141004:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028160 00010000:00010000:3.0:1788587248.141045:0:14433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 12 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587248.141087:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:3.0:1788587248.141096:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:2361:x1875469182028160:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587248.141111:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587248.141117:0:14433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 12 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141141:0:14433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 12 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141168:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbeed3000/0xc1a730b05ab89e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b3a expref: 12 pid: 14439 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141185:0:14433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141193:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141221:0:14433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141228:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141249:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141257:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141263:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3800 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:3.0:1788587248.141267:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141275:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141366:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587248.141381:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587248.141433:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:2361:x1875469182028160:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 338us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587248.141439:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00010000:00010000:2.0:1788587248.143185:0:16563:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.143202:0:16563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587248.143208:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8bacbeed3800/0xc1a730b05ab89e7d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587248.963675:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587249.156427:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208233216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788587249.156491:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.156538:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208233728:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.156571:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.156596:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788587249.156601:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208233600:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.156635:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.156669:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208233344:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.156694:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.156712:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208233856:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.156729:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.156743:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587249.156748:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208233472:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.156764:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.156777:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208233984:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.156791:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.156816:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233216 00000100:00100000:3.0:1788587249.156822:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233216 00000100:00100000:3.0:1788587249.156889:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587249.156898:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208233216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587249.156929:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587249.156966:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208233216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587249.156973:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788587249.156991:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233728 00000100:00100000:3.0:1788587249.156994:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233728 00000100:00100000:1.0:1788587249.158242:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233600 00000100:00100000:1.0:1788587249.158253:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233600 00000100:00100000:1.0:1788587249.158308:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233472 00000100:00100000:1.0:1788587249.158310:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233472 00000100:00100000:1.0:1788587249.158329:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587249.158336:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208233600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587249.158462:0:15132:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788587249.158472:0:15132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788587249.158592:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788587249.158600:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208233472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.163697:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233856 00000100:00100000:3.0:1788587249.163717:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233856 00000100:00100000:3.0:1788587249.163770:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233984 00000100:00100000:3.0:1788587249.163774:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233984 00000100:00100000:3.0:1788587249.163801:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587249.163812:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208233728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587249.164755:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788587249.164771:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208233856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587249.164931:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208233472:12345-0@lo:400:kworker.0 Request processed in 6330us (8163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587249.164941:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788587249.166567:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788587249.166579:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788587249.166599:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788587249.166796:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208233216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587249.166836:0:14448:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788587249.166864:0:14448:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788587249.167159:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208233600:12345-0@lo:400:kworker.0 Request processed in 8821us (10521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.167170:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788587249.167199:0:14449:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788587249.167209:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587249.167220:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208233984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587249.167275:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208233984:12345-0@lo:400:kworker.0 Request processed in 59us (10482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.167287:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788587249.167325:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208233344 00000100:00100000:1.0:1788587249.167332:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208233344 00000100:00100000:1.0:1788587249.167554:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788587249.167563:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:3312:x1875469208233344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587249.167599:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:3312:x1875469208233344:12345-0@lo:400:kworker.0 Request processed in 39us (10905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.167606:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788587249.167965:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208233600:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.168129:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208233728:12345-0@lo:400:kworker.0 Request processed in 4318us (11555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587249.168150:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788587249.168195:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208233472:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.168208:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208233984:0@lo:400:kworker.0 00000100:00100000:3.0:1788587249.168218:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208233344:0@lo:400:kworker.0 00000100:00100000:2.0:1788587249.177286:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208233728:0@lo:400:kworker.0 00000100:00100000:0.0:1788587249.179893:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208233856:12345-0@lo:400:kworker.0 Request processed in 15119us (23154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587249.179908:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788587249.180827:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208233856:0@lo:400:kworker.0 10000000:01000000:2.0:1788587249.617560:0:14444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788587249.617570:0:14444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacaf19c000 from 10 10000000:01000000:2.0:1788587249.617576:0:14444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788587249.617639:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89e84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587249.617652:0:14444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89e84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587249.617664:0:14444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89e84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587249.617692:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788587249.617756:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587249.618164:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac860046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587249.626353:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208234112 00000100:00100000:1.0:1788587249.626371:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208234112 00000100:00100000:0.0:1788587249.626553:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788587249.626565:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+16:14444:x1875469208234112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587249.626581:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587249.626603:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc1a98800/0xc1a730b05ab89e8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89e84 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.626641:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc1a98800/0xc1a730b05ab89e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89e84 expref: 17 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.626652:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc1a98800/0xc1a730b05ab89e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89e84 expref: 17 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.626662:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a98800, rc 0) 00000100:00100000:0.0:1788587249.626737:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:14444:x1875469208234112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (8979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587249.626743:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788587249.626798:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacc18e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788587249.626816:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89e84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89e8b expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.626824:0:14444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89e84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89e8b expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587249.626917:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.626964:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587249.626989:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208234240 00000100:00100000:0.0:1788587249.626993:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208234240 00000100:00100000:0.0:1788587249.627015:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788587249.627021:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:14444:x1875469208234240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.627249:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:14444:x1875469208234240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587249.627256:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788587249.627287:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587249.627319:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.627348:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.627384:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587249.627403:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208234368 00000100:00100000:0.0:1788587249.627407:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208234368 00000100:00100000:0.0:1788587249.627426:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788587249.627432:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:14444:x1875469208234368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.627574:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:14444:x1875469208234368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587249.627582:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788587249.627612:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788587249.627623:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788587249.635228:0:16622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788587249.635552:0:14444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788587249.635578:0:14444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587249.635590:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89e84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89e8b expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.635621:0:14444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacbf9d4c00/0xc1a730b05ab89e84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89e8b expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587249.635632:0:14444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587249.635635:0:14444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bacbbcd6800 from 10 10000000:01000000:0.0:1788587249.635638:0:14444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587249.635681:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99800/0xc1a730b05ab89e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.635689:0:14444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99800/0xc1a730b05ab89e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.635699:0:14444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99800/0xc1a730b05ab89e92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587249.635726:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.635791:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587249.635872:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788587249.635956:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208234496 00000100:00100000:1.0:1788587249.635964:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208234496 00000100:00100000:1.0:1788587249.636009:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788587249.636019:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd22a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+17:14444:x1875469208234496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587249.636033:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587249.636047:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbeed2600/0xc1a730b05ab89e99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89e92 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.636071:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbeed2600/0xc1a730b05ab89e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89e92 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.636081:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbeed2600/0xc1a730b05ab89e99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89e92 expref: 18 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.636091:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed2600, rc 0) 00000100:00100000:1.0:1788587249.636137:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd22a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:14444:x1875469208234496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.636143:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788587249.636245:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587249.636258:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99800/0xc1a730b05ab89e92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89e99 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587249.636267:0:14444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99800/0xc1a730b05ab89e92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89e99 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587249.636334:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587249.636363:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.636384:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab832ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587249.636493:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208234624 00000100:00100000:1.0:1788587249.636497:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208234624 00000100:00100000:1.0:1788587249.636541:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788587249.636549:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:14444:x1875469208234624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587249.636781:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd228050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:14444:x1875469208234624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.636788:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788587249.638487:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587249.638560:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb4d83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587249.638632:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587249.638674:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bab832ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1788587249.638725:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208234752 00000100:00100000:1.0:1788587249.638732:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208234752 00000100:00100000:1.0:1788587249.638774:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788587249.638783:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbd229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:14444:x1875469208234752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788587249.638992:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbd229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:14444:x1875469208234752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.639000:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788587249.640340:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb4d83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788587249.641601:0:16623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788587249.641909:0:14444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788587249.641929:0:14444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788587249.641939:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99800/0xc1a730b05ab89e92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89e99 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.641950:0:14444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99800/0xc1a730b05ab89e92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89e99 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788587249.641960:0:14444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788587249.641963:0:14444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8bac82bbc800 from 10 10000000:01000000:0.0:1788587249.641965:0:14444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788587249.642016:0:14444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab89ea0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.642023:0:14444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab89ea0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587249.642033:0:14444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab89ea0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587249.642057:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.642124:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587249.642163:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788587249.644226:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208234880 00000100:00100000:1.0:1788587249.644242:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208234880 00000100:00100000:1.0:1788587249.644506:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587249.644518:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+18:14444:x1875469208234880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587249.644547:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587249.644568:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacbeed2c00/0xc1a730b05ab89ea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc1a730b05ab89ea0 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.644601:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacbeed2c00/0xc1a730b05ab89ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc1a730b05ab89ea0 expref: 19 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.644625:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacbeed2c00/0xc1a730b05ab89ea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc1a730b05ab89ea0 expref: 19 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.644648:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed2c00, rc 0) 00000100:00100000:1.0:1788587249.644728:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208234880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.644734:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788587249.644787:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208234880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788587249.644806:0:14444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab89ea0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89ea7 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.644818:0:14444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab89ea0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc1a730b05ab89ea7 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587249.644925:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208235008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587249.644962:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587249.644990:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac82ba5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788587249.645003:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208235008 00000100:00100000:1.0:1788587249.645006:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208235008 00000100:00100000:1.0:1788587249.645031:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788587249.645037:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208235008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788587249.645274:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208235008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.645281:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788587249.645589:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208235008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.645621:0:14444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208235136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.645661:0:14444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587249.645692:0:14444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90c4a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788587249.645733:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208235136 00000100:00100000:3.0:1788587249.645743:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208235136 00000100:00100000:3.0:1788587249.645765:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788587249.645772:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208235136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788587249.646103:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:14444:x1875469208235136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587249.646111:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788587249.646432:0:14444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7044063-f08f-49f3-baab-c8410dd7f9cc:14444:1875469208235136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788587249.650260:0:16624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788587249.660878:0:14444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788587249.661197:0:14444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.128@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788587249.661211:0:14444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab89ea0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89ea7 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587249.661239:0:14444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.128@tcp lock: ffff8bacc1a99200/0xc1a730b05ab89ea0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc1a730b05ab89ea7 expref: -99 pid: 14444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587249.671413:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208235264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587249.671522:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788587249.671651:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208235264 00000100:00100000:1.0:1788587249.671664:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208235264 00000100:00100000:1.0:1788587249.671716:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587249.671726:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208235264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788587249.671769:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788587249.671819:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208235264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587249.671826:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788587249.671897:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bac912ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208235264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587249.744995:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587249.745086:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028288 00000100:00100000:3.0:1788587249.745096:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028288 00000100:00100000:3.0:1788587249.745158:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:3.0:1788587249.745169:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf4c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+11:13778:x1875469182028288:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587249.745184:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587249.745202:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050a00/0xc1a730b05ab89eae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2bcd expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587249.745232:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050a00/0xc1a730b05ab89eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bcd expref: 12 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587249.745244:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050a00/0xc1a730b05ab89eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bcd expref: 12 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587249.745253:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050a00, rc 0) 00000100:00100000:3.0:1788587249.745321:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf4c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13778:x1875469182028288:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 154us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587249.745328:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 115 00000100:00100000:3.0:1788587249.748642:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587249.748783:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028416 00000100:00100000:0.0:1788587249.748793:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028416 00000100:00100000:0.0:1788587249.748866:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:0.0:1788587249.748876:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13778:x1875469182028416:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.749156:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13778:x1875469182028416:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 279us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587249.749163:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 116 00000100:00100000:3.0:1788587249.751031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587249.751111:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028544 00000100:00100000:0.0:1788587249.751132:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028544 00000100:00100000:0.0:1788587249.751180:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:0.0:1788587249.751189:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13778:x1875469182028544:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788587249.751420:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13778:x1875469182028544:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 231us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587249.751428:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 117 00000100:00100000:3.0:1788587249.783962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587249.783997:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028672 00000100:00100000:3.0:1788587249.784019:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028672 00000100:00100000:3.0:1788587249.784074:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:3.0:1788587249.784084:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+12:13778:x1875469182028672:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788587249.784101:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587249.784122:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8bacc2050000/0xc1a730b05ab89eb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2bd4 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587249.784152:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8bacc2050000/0xc1a730b05ab89eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bd4 expref: 13 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587249.784165:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8bacc2050000/0xc1a730b05ab89eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bd4 expref: 13 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587249.784174:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2050000, rc 0) 00000100:00100000:3.0:1788587249.784230:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13778:x1875469182028672:12345-192.168.204.28@tcp:101:ll_cfg_requeue.0 Request processed in 147us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587249.784237:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 118 00000100:00100000:3.0:1788587249.790799:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587249.790839:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028800 00000100:00100000:3.0:1788587249.790868:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028800 00000100:00100000:3.0:1788587249.790922:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:3.0:1788587249.790932:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13778:x1875469182028800:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788587249.791219:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13778:x1875469182028800:12345-192.168.204.28@tcp:501:ll_cfg_requeue.0 Request processed in 287us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587249.791227:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 119 00000100:00100000:2.0:1788587249.802499:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587249.804243:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182028928 00000100:00100000:2.0:1788587249.804258:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182028928 00000100:00100000:2.0:1788587249.804617:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 120 00000100:00100000:2.0:1788587249.804630:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13778:x1875469182028928:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788587249.806755:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:13778:x1875469182028928:12345-192.168.204.28@tcp:503:ll_cfg_requeue.0 Request processed in 2117us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587249.806778:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 120 00010000:00010000:0.0:1788587250.001678:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587251.011028:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587252.036607:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587252.241119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.241168:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.241219:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.241259:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.241279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.241297:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.241320:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587252.241535:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029056 00000100:00100000:0.0:1788587252.241546:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029056 00000100:00100000:0.0:1788587252.241618:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:0.0:1788587252.241629:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2362:x1875469182029056:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:0.0:1788587252.241703:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2362:x1875469182029056:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 76us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587252.241711:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 121 00000100:00100000:2.0:1788587252.242334:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029312 00000100:00100000:2.0:1788587252.242340:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029312 00000100:00100000:2.0:1788587252.242381:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029824 00000100:00100000:2.0:1788587252.242385:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029824 00000100:00100000:2.0:1788587252.242408:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029440 00000100:00100000:2.0:1788587252.242412:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029440 00000100:00100000:2.0:1788587252.242424:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029696 00000100:00100000:2.0:1788587252.242427:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029696 00000100:00100000:2.0:1788587252.242440:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1788587252.242447:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2362:x1875469182029312:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587252.242500:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2362:x1875469182029312:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 53us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587252.242506:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1788587252.242519:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788587252.242525:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2362:x1875469182029824:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587252.242548:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2362:x1875469182029824:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 24us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587252.242554:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788587252.242567:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788587252.242573:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2362:x1875469182029440:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587252.242595:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2362:x1875469182029440:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 23us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587252.242601:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:2.0:1788587252.242612:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1788587252.242629:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2362:x1875469182029696:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587252.242651:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2362:x1875469182029696:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 23us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587252.242657:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1788587252.242677:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029568 00000100:00100000:2.0:1788587252.242680:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029568 00000100:00100000:2.0:1788587252.242704:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029184 00000100:00100000:2.0:1788587252.242707:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029184 00000100:00100000:2.0:1788587252.242725:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1788587252.242731:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2362:x1875469182029568:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587252.242760:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2362:x1875469182029568:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 29us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587252.242766:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:2.0:1788587252.242777:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:2.0:1788587252.242783:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2362:x1875469182029184:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587252.242805:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2362:x1875469182029184:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 22us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587252.242810:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00080000:0.0:1788587252.243601:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587252.243607:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788587252.243609:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788587252.789194:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587252.797594:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182029952 00000100:00100000:0.0:1788587252.797618:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182029952 00000100:00100000:0.0:1788587252.797754:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:0.0:1788587252.797769:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:14437:x1875469182029952:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587252.797798:0:16533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587252.804197:0:16533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2bdb expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.804339:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.804360:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.804380:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.804426:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.804434:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.804442:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806481:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2e00/0xc1a730b05ab89ed1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806519:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2e00/0xc1a730b05ab89ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806535:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2e00/0xc1a730b05ab89ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587252.806580:0:16533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587252.806585:0:16533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587252.806644:0:16533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2e00/0xc1a730b05ab89ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806659:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806666:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806674:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806706:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587252.806712:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806720:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806737:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:1.0:1788587252.806741:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.806747:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806754:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806771:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806777:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806782:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806787:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587252.806789:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.806795:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.813595:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8bacc216c400) 00010000:00010000:1.0:1788587252.813600:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.813610:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.813621:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89eca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.814454:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bdb expref: 8 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.814492:0:16533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2e00/0xc1a730b05ab89ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bdb expref: 7 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.814509:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bacc216ce00) 00010000:00010000:1.0:1788587252.814513:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587252.814516:0:16533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed2e00, rc 0) 00000100:00100000:1.0:1788587252.814622:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb4d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:14437:x1875469182029952:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 16856us (25450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587252.814633:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1788587252.848966:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587252.849161:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182030208 00000100:00100000:1.0:1788587252.849175:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182030208 00000100:00100000:1.0:1788587252.849264:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:1.0:1788587252.849276:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:14437:x1875469182030208:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587252.849307:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587252.849340:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89ed8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2be2 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.849507:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.849529:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.849545:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.854906:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.854933:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.854946:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.855358:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3600/0xc1a730b05ab89eed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.855369:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3600/0xc1a730b05ab89eed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.855377:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3600/0xc1a730b05ab89eed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587252.855388:0:14449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788587252.861278:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861317:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861326:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861332:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587252.861337:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861346:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861364:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8bacc216ce00) 00010000:00010000:1.0:1788587252.861367:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.861372:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861378:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89edf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861395:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861402:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861408:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861413:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587252.861421:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861428:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861436:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8bacc216c400) 00010000:00010000:1.0:1788587252.861439:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.861442:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.861448:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89ee6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.870271:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89ed8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2be2 expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.870299:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3600/0xc1a730b05ab89eed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2be2 expref: 9 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.870309:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bacc216c800) 00010000:00010000:1.0:1788587252.870312:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.870316:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed3600, rc 0) 00000100:00100000:1.0:1788587252.870456:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14437:x1875469182030208:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 21181us (21505us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788587252.870466:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1788587252.896980:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.897072:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182030336 00000100:00100000:3.0:1788587252.897086:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182030336 00000100:00100000:3.0:1788587252.897168:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:3.0:1788587252.897179:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14437:x1875469182030336:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788587252.897325:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14437:x1875469182030336:12345-192.168.204.28@tcp:59:lhsmtool_posix.0 Request processed in 147us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587252.897334:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:2.0:1788587252.903910:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587252.904016:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182030464 00000100:00100000:1.0:1788587252.904033:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182030464 00000100:00100000:1.0:1788587252.904103:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:1.0:1788587252.904114:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14443:x1875469182030464:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587252.904155:0:16533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587252.904182:0:16533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2be9 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904266:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904282:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904294:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904307:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904314:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904320:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904522:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904530:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904537:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904542:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587252.904551:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904559:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904570:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:1.0:1788587252.904573:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.904577:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904584:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904597:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904604:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904610:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904615:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587252.904617:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904623:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904629:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bacc216c400) 00010000:00010000:1.0:1788587252.904631:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.904638:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904644:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904677:0:16533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89efb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2be9 expref: 10 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904686:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:1.0:1788587252.904689:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.904692:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2be9 expref: 10 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.904701:0:16533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed2000, rc 0) 00000100:00100000:0.0:1788587252.906448:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14443:x1875469182030464:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 2325us (2594us total) trans 0 rc 301/301 00000100:00100000:0.0:1788587252.906460:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:2.0:1788587252.924724:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.925001:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182030592 00000100:00100000:3.0:1788587252.925011:0:14456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182030592 00000100:00100000:3.0:1788587252.925061:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:3.0:1788587252.925071:0:14456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14443:x1875469182030592:12345-192.168.204.28@tcp:700:lfs.0 00000100:00100000:3.0:1788587252.925189:0:14456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14443:x1875469182030592:12345-192.168.204.28@tcp:700:lfs.0 Request processed in 119us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587252.925196:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1788587252.937149:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587252.938673:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182030848 00000100:00100000:1.0:1788587252.938691:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182030848 00000100:00100000:1.0:1788587252.938785:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:1.0:1788587252.938796:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14443:x1875469182030848:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:1.0:1788587252.938905:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587252.938940:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab89e3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2b64 expref: 9 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.938962:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:1.0:1788587252.938968:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587252.939220:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.939247:0:14449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 5 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.939264:0:14449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.939302:0:14449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 5 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.939317:0:14449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 5 pid: 14448 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587252.939333:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb5b80700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14449:1875469208235392:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587252.940174:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac903466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587252.947422:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb5b80700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14449:1875469208235392:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587252.947457:0:14449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587252.954756:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587252.955771:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182030976 00000100:00100000:3.0:1788587252.955785:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182030976 00010000:00010000:3.0:1788587252.955898:0:14432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 6 pid: 14448 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587252.955943:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:3.0:1788587252.955954:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2362:x1875469182030976:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788587252.955969:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587252.955975:0:14432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 6 pid: 14448 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.955989:0:14432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 6 pid: 14448 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.956013:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89e76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bc6 expref: 6 pid: 14448 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.956030:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:3.0:1788587252.956035:0:14432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.956044:0:14432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.956051:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.956086:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587252.956141:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2362:x1875469182030976:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 189us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587252.956148:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00010000:00010000:1.0:1788587252.956326:0:14449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.956335:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.956360:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.956369:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.956377:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587252.958044:0:14449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788587252.958060:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.958081:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.958089:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.958096:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587252.958101:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.958111:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.958128:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8baca0968f00) 00010000:00010000:1.0:1788587252.958131:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587252.958135:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587252.958142:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2000/0xc1a730b05ab89f10 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788587252.958166:0:14449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058435784 reply state 000000008b6b9520 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587252.958174:0:14449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587252.958252:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+10:14443:x1875469182030848:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 19454us (21110us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788587252.958260:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00010000:00010000:3.0:1788587252.962450:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.962481:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.962489:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.962495:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587252.962501:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.962509:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.962526:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bacc216c400) 00010000:00010000:3.0:1788587252.962529:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587252.962534:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587252.962541:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3400/0xc1a730b05ab89f17 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.059345:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788587253.148834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.149178:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182031104 00000100:00100000:3.0:1788587253.149190:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182031104 00000100:00100000:3.0:1788587253.149267:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:3.0:1788587253.149278:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:14451:x1875469182031104:12345-192.168.204.28@tcp:101:lctl.0 00010000:00010000:3.0:1788587253.149303:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587253.149329:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89f1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2bf0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.149922:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89f25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.149940:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.149952:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587253.149986:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587253.149990:0:14447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587253.150037:0:14447:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.150063:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89f1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bf0 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.150083:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051c00/0xc1a730b05ab89f25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bf0 expref: 10 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.150101:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:3.0:1788587253.150104:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788587253.150108:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051c00, rc 0) 00000100:00100000:3.0:1788587253.150163:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+10:14451:x1875469182031104:12345-192.168.204.28@tcp:101:lctl.0 Request processed in 887us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587253.150170:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1788587253.190946:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587253.191235:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182031232 00000100:00100000:0.0:1788587253.191248:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182031232 00000100:00100000:0.0:1788587253.191318:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:0.0:1788587253.191332:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacc18e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:14452:x1875469182031232:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587253.191352:0:16533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587253.191374:0:16533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab89f2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2bf7 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.191454:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89f33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.191477:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.191489:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587253.191527:0:16533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587253.191531:0:16533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587253.191550:0:16533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89f33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.191576:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab89f2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bf7 expref: 7 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.191594:0:16533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99600/0xc1a730b05ab89f33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bf7 expref: 6 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.191603:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:0.0:1788587253.191607:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587253.191624:0:16533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99600, rc 0) 00000100:00100000:0.0:1788587253.192475:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacc18e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:14452:x1875469182031232:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 369us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587253.192487:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:0.0:1788587253.197136:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587253.197347:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182031360 00000100:00100000:1.0:1788587253.197358:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182031360 00000100:00100000:1.0:1788587253.197450:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:1.0:1788587253.197461:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:14452:x1875469182031360:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:1.0:1788587253.197495:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587253.197516:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2bfe expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197586:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197601:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197612:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197625:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197631:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197637:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197739:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3800/0xc1a730b05ab89f4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197747:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3800/0xc1a730b05ab89f4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197754:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3800/0xc1a730b05ab89f4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788587253.197797:0:14449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788587253.197801:0:14449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788587253.197822:0:14449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3800/0xc1a730b05ab89f4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197836:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197870:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197880:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197886:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587253.197890:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197899:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197916:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:1.0:1788587253.197919:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587253.197925:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197931:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3200/0xc1a730b05ab89f41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197947:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197963:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197969:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197974:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed2200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587253.197977:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197984:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.197992:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bacc216c600) 00010000:00010000:1.0:1788587253.197995:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788587253.197998:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.198004:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2200/0xc1a730b05ab89f48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.198050:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed2400/0xc1a730b05ab89f3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bfe expref: 8 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.198065:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3800/0xc1a730b05ab89f4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bfe expref: 7 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.198073:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bacc216c500) 00010000:00010000:1.0:1788587253.198075:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788587253.198084:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed3800, rc 0) 00000100:00100000:1.0:1788587253.198162:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+7:14452:x1875469182031360:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 702us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587253.198170:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:1.0:1788587253.213983:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.214122:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182031616 00000100:00100000:3.0:1788587253.214133:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182031616 00000100:00100000:3.0:1788587253.214201:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:3.0:1788587253.214211:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+7:14452:x1875469182031616:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587253.214246:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587253.214269:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89f56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c05 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587253.214367:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788587253.214523:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89f56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c05 expref: 9 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.214538:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:3.0:1788587253.214541:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587253.214547:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89f56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c05 expref: 9 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.214561:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc2051200, rc 0) 00000100:00100000:3.0:1788587253.214630:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+8:14452:x1875469182031616:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 420us (657us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788587253.214637:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:0.0:1788587253.223445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.226907:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182031872 00000100:00100000:3.0:1788587253.226925:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182031872 00000100:00100000:3.0:1788587253.227016:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 24 00000100:00100000:3.0:1788587253.227027:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+8:14452:x1875469182031872:12345-192.168.204.28@tcp:36:lfs.0 00010000:00010000:3.0:1788587253.227088:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788587253.227131:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3800/0xc1a730b05ab89f4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2bfe expref: 8 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.227172:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bacc216c500) 00010000:00010000:3.0:1788587253.227184:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587253.227209:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.227222:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.227232:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587253.227482:0:14448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010757fac reply state 000000009a3193e5 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587253.227491:0:14448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788587253.227500:0:14448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788587253.227592:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+9:14452:x1875469182031872:12345-192.168.204.28@tcp:36:lfs.0 Request processed in 566us (4159us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788587253.227599:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 24 00010000:00010000:1.0:1788587253.232159:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.232177:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.232184:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.232190:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:1.0:1788587253.232196:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.232204:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.232222:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac987bc100) 00010000:00010000:1.0:1788587253.232225:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788587253.232230:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587253.232237:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f64 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587253.240907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.240994:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182032128 00000100:00100000:3.0:1788587253.241006:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182032128 00000100:00100000:3.0:1788587253.241080:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:3.0:1788587253.241091:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac912ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+8:14452:x1875469182032128:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:3.0:1788587253.241361:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac912ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+9:14452:x1875469182032128:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 271us (464us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788587253.241369:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:0.0:1788587253.244454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587253.244562:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182032384 00000100:00100000:2.0:1788587253.244584:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182032384 00000100:00100000:2.0:1788587253.244644:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1788587253.244654:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35b9e3bf-ee50-43fc-85f3-0213efdb22be+9:14452:x1875469182032384:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587253.244679:0:16597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587253.244699:0:16597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab89f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c0c expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.244776:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.244792:0:16597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.244803:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.244817:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.244825:0:16597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.244831:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587253.244980:0:16597:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587253.245086:0:16597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245108:0:16597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245125:0:16597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245132:0:16597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587253.245136:0:16597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245144:0:16597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245157:0:16597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:2.0:1788587253.245160:0:16597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587253.245165:0:16597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245171:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab89f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245184:0:16597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245191:0:16597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245197:0:16597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245202:0:16597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587253.245205:0:16597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245221:0:16597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245230:0:16597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8baca0968e00) 00010000:00010000:2.0:1788587253.245232:0:16597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587253.245235:0:16597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245241:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab89f79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245282:0:16597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab89f6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c0c expref: 11 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245293:0:16597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:2.0:1788587253.245295:0:16597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587253.245299:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab89f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c0c expref: 11 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.245307:0:16597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4600, rc 0) 00000100:00100000:2.0:1788587253.245359:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:35b9e3bf-ee50-43fc-85f3-0213efdb22be+10:14452:x1875469182032384:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 707us (916us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788587253.245368:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 25 00000100:00100000:2.0:1788587253.261927:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587253.262025:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182032512 00000100:00100000:0.0:1788587253.262035:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182032512 00000100:00100000:0.0:1788587253.262086:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:0.0:1788587253.262110:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b9e3bf-ee50-43fc-85f3-0213efdb22be+10:14452:x1875469182032512:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587253.262137:0:16533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587253.262159:0:16533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab89f87 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c13 expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.262258:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.262274:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.262286:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587253.262312:0:16533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788587253.262315:0:16533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587253.262334:0:16533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.262384:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab89f87 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 12 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.262402:0:16533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 11 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.262412:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:0.0:1788587253.262415:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788587253.262419:0:16533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587253.262544:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:35b9e3bf-ee50-43fc-85f3-0213efdb22be+11:14452:x1875469182032512:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 449us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587253.262552:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 26 00000100:00100000:1.0:1788587253.282423:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.282664:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182032640 00000100:00100000:3.0:1788587253.282687:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182032640 00000100:00100000:3.0:1788587253.282752:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:3.0:1788587253.282763:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+11:14452:x1875469182032640:12345-192.168.204.28@tcp:37:lfs.0 00000100:00100000:2.0:1788587253.301517:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35b9e3bf-ee50-43fc-85f3-0213efdb22be+11:14452:x1875469182032640:12345-192.168.204.28@tcp:37:lfs.0 Request processed in 18744us (19092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587253.301535:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 3 00000100:00100000:2.0:1788587253.327415:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587253.327568:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182032896 00000100:00100000:0.0:1788587253.327578:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182032896 00000100:00100000:0.0:1788587253.327636:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:0.0:1788587253.327646:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac889c3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+11:14452:x1875469182032896:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587253.327903:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac889c3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+12:14452:x1875469182032896:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 258us (499us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788587253.327911:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 4 00000100:00100000:1.0:1788587253.457488:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.457633:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182033024 00000100:00100000:3.0:1788587253.457644:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182033024 00000100:00100000:3.0:1788587253.457711:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:3.0:1788587253.457723:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+10:14458:x1875469182033024:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587253.457887:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587253.457911:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89f95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c1a expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.457974:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.457990:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.458003:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460682:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460696:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460708:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460814:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5800/0xc1a730b05ab89faa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460837:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5800/0xc1a730b05ab89faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460860:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5800/0xc1a730b05ab89faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587253.460898:0:14449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788587253.460902:0:14449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587253.460943:0:14449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5800/0xc1a730b05ab89faa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460955:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460962:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460968:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460974:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacc2050800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587253.460978:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460985:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.460995:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:3.0:1788587253.460998:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587253.461004:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461021:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2050800/0xc1a730b05ab89f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461035:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461042:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461047:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461052:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587253.461055:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461062:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461070:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8bac987bc600) 00010000:00010000:3.0:1788587253.461073:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587253.461075:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.461081:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.462278:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc2051200/0xc1a730b05ab89f95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c1a expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.462319:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5800/0xc1a730b05ab89faa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c1a expref: 11 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.462326:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:3.0:1788587253.462328:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788587253.462331:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5800, rc 0) 00000100:00100000:3.0:1788587253.462406:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+11:14458:x1875469182033024:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4686us (4930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587253.462415:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 27 00000100:00100000:1.0:1788587253.470522:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.470888:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182033280 00000100:00100000:3.0:1788587253.470899:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182033280 00000100:00100000:3.0:1788587253.470963:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 28 00000100:00100000:3.0:1788587253.470973:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+11:14458:x1875469182033280:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587253.470993:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587253.471025:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fb1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c21 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.471333:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.471349:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 11 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.471359:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.471396:0:14447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 11 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.471417:0:14447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 11 pid: 16533 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587253.471432:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14447:1875469208235520:192.168.204.28@tcp:104: 00000100:00100000:3.0:1788587253.471578:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98081a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788587253.496265:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587253.496362:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182033408 00000100:00100000:0.0:1788587253.496383:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182033408 00010000:00010000:0.0:1788587253.496439:0:14434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 12 pid: 16533 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587253.496496:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1788587253.496506:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+12:2361:x1875469182033408:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587253.496537:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587253.496544:0:14434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 12 pid: 16533 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.496558:0:14434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 12 pid: 16533 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.496583:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:0.0:1788587253.496588:0:14434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.496598:0:14434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.496606:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587253.496627:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587253.496688:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+12:2361:x1875469182033408:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 183us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587253.496695:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00010000:00010000:3.0:1788587253.496905:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab89f8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c13 expref: 11 pid: 16533 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587253.496921:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14447:1875469208235520:192.168.204.28@tcp:104: 00010000:00010000:3.0:1788587253.496943:0:14447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.496951:0:14447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.496958:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.496981:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.496990:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.496998:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497708:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497727:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497735:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587253.497749:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788587253.497782:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497790:0:14447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497797:0:14447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497803:0:14447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587253.497807:0:14447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497816:0:14447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497827:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:3.0:1788587253.497830:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587253.497833:0:14447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497886:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89fb8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587253.497898:0:14447:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000528823c0 reply state 00000000440486b2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587253.497914:0:14447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788587253.497952:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fb1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 14 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497968:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 13 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.497975:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:3.0:1788587253.497977:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788587253.497980:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4200, rc 0) 00000100:00100000:3.0:1788587253.498024:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+14:14458:x1875469182033280:12345-192.168.204.28@tcp:101:bash.0 Request processed in 27052us (27512us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788587253.498033:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 28 00010000:00010000:3.0:1788587253.507826:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.507870:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.507878:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.507884:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587253.507890:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.507899:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.507939:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8bac987bc600) 00010000:00010000:3.0:1788587253.507942:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587253.507948:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.507955:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fbf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587253.558980:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.559499:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182033536 00000100:00100000:3.0:1788587253.559512:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182033536 00000100:00100000:3.0:1788587253.559576:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:3.0:1788587253.559587:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+13:14458:x1875469182033536:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587253.559614:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587253.559637:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fd4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c28 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.559723:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fdb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.559740:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.559753:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587253.559801:0:14448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788587253.559806:0:14448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587253.559826:0:14448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.559899:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.559944:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fd4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c28 expref: 15 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.559967:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c28 expref: 14 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.559976:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:3.0:1788587253.559980:0:14448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587253.559983:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5400, rc 0) 00000100:00100000:3.0:1788587253.560064:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+14:14458:x1875469182033536:12345-192.168.204.28@tcp:101:bash.0 Request processed in 477us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587253.560071:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 29 00000100:00100000:1.0:1788587253.577399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587253.577507:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182033792 00000100:00100000:0.0:1788587253.577517:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182033792 00000100:00100000:0.0:1788587253.577575:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 5 00000100:00100000:0.0:1788587253.577586:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+14:14458:x1875469182033792:12345-192.168.204.28@tcp:35:bash.0 00000100:00100000:0.0:1788587253.578016:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:14458:x1875469182033792:12345-192.168.204.28@tcp:35:bash.0 Request processed in 431us (629us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788587253.578024:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 5 00000040:00080000:3.0:1788587253.637637:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788587253.745438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.745584:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182034048 00000100:00100000:3.0:1788587253.745594:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182034048 00000100:00100000:3.0:1788587253.745656:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:3.0:1788587253.745667:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb5b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:14468:x1875469182034048:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587253.745701:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587253.745724:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c2f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587253.745817:0:14449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788587253.745976:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fe2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c2f expref: 17 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.746009:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:3.0:1788587253.746013:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788587253.746018:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89fe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c2f expref: 17 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.746032:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5000, rc 0) 00000100:00100000:3.0:1788587253.746084:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb5b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+16:14468:x1875469182034048:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 419us (657us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788587253.746091:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 30 00000100:00100000:1.0:1788587253.760958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587253.761494:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182034304 00000100:00100000:0.0:1788587253.761505:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182034304 00000100:00100000:0.0:1788587253.761572:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:0.0:1788587253.761581:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+16:14468:x1875469182034304:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587253.761825:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14468:x1875469182034304:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 244us (875us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788587253.761833:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 6 00000100:00100000:1.0:1788587253.872488:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587253.872620:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182034560 00000100:00100000:3.0:1788587253.872630:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182034560 00000100:00100000:3.0:1788587253.872710:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:3.0:1788587253.872722:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14471:x1875469182034560:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:3.0:1788587253.872749:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587253.872780:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89ff0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c36 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.873162:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89ff7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.873179:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.873193:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587253.873205:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788587253.873361:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab89ff0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c36 expref: 20 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.873379:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c36 expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587253.873387:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:3.0:1788587253.873389:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587253.873392:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5200, rc 0) 00000100:00100000:3.0:1788587253.873469:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14471:x1875469182034560:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 749us (993us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788587253.873476:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 31 00000100:00100000:1.0:1788587253.886270:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587253.886381:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182034688 00000100:00100000:2.0:1788587253.886392:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182034688 00000100:00100000:2.0:1788587253.886463:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:2.0:1788587253.886474:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14471:x1875469182034688:12345-192.168.204.28@tcp:54:lfs.0 00010000:00010000:2.0:1788587253.886548:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886566:0:16597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886580:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886609:0:16597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886617:0:16597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886624:0:16597:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886629:0:16597:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587253.886633:0:16597:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886651:0:16597:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886663:0:16597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:2.0:1788587253.886677:0:16597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587253.886683:0:16597:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.886696:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a005 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587253.886769:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14471:x1875469182034688:12345-192.168.204.28@tcp:54:lfs.0 Request processed in 297us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587253.886776:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 32 00000100:00100000:1.0:1788587253.889587:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587253.889676:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182034944 00000100:00100000:0.0:1788587253.889694:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182034944 00000100:00100000:0.0:1788587253.889741:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:0.0:1788587253.889750:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14471:x1875469182034944:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587253.890012:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:14471:x1875469182034944:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 262us (431us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788587253.890140:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 7 00000100:00100000:1.0:1788587253.894401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587253.894555:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182035072 00000100:00100000:2.0:1788587253.894566:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182035072 00000100:00100000:2.0:1788587253.894699:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:2.0:1788587253.894711:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:2362:x1875469182035072:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587253.894729:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587253.894755:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5200/0xc1a730b05ab89ff7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c36 expref: 20 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587253.894785:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:2.0:1788587253.894791:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587253.894893:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:2362:x1875469182035072:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 184us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587253.894901:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00010000:00010000:1.0:1788587254.083613:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788587254.275545:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab81f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208235776:0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.275632:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587254.275685:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208236288:0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.275711:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587254.275737:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788587254.275741:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208235904:0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.275777:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587254.275798:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208236416:0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.275817:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587254.275870:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208235904 00000100:00100000:3.0:1788587254.275877:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208235904 00000100:00080000:0.0:1788587254.276006:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788587254.276019:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208236288 00000100:00100000:0.0:1788587254.276024:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208236288 00000100:00080000:0.0:1788587254.276041:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587254.276078:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208236416 00000100:00100000:0.0:1788587254.276082:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208236416 00000100:00100000:0.0:1788587254.276114:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587254.276123:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208236288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587254.276188:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208236288:12345-0@lo:400:kworker.0 Request processed in 66us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587254.276197:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788587254.276232:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788587254.276239:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208236416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587254.276286:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208236416:12345-0@lo:400:kworker.0 Request processed in 48us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587254.276293:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788587254.276311:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788587254.276339:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208236416:0@lo:400:kworker.0 00000100:00100000:0.0:1788587254.276351:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208236288:0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.277042:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788587254.277056:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208235904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.277105:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875469208235904:12345-0@lo:400:kworker.0 Request processed in 54us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587254.277119:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788587254.277376:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208235648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587254.277415:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587254.277456:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208236160:0@lo:400:kworker.0 00000100:00100000:2.0:1788587254.277481:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587254.277508:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788587254.277514:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208236032:0@lo:400:kworker.0 00000100:00100000:2.0:1788587254.277534:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587254.277563:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208235776 00000100:00100000:2.0:1788587254.277569:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208235776 00000100:00100000:2.0:1788587254.277596:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788587254.277604:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3312:x1875469208235776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587254.277634:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3312:x1875469208235776:12345-0@lo:400:kworker.0 Request processed in 31us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587254.277640:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788587254.278377:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208236032 00000100:00100000:1.0:1788587254.278385:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208236032 00000100:00100000:1.0:1788587254.278435:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788587254.278455:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208236032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788587254.278510:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208236032:12345-0@lo:400:kworker.0 Request processed in 68us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587254.278517:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788587254.278539:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788587254.278568:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208236032:0@lo:400:kworker.0 00000100:00100000:0.0:1788587254.278736:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875469208235904:0@lo:400:kworker.0 00000100:00100000:0.0:1788587254.278748:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab81f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208235776:0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.279344:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208235648 00000100:00100000:3.0:1788587254.279365:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208235648 00000100:00100000:3.0:1788587254.279416:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587254.279424:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208235648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788587254.279468:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587254.279540:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208235648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587254.279547:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788587254.279569:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208236160 00000100:00100000:3.0:1788587254.279573:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208236160 00000100:00100000:3.0:1788587254.279608:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788587254.279616:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208236160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788587254.279649:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875469208236160:12345-0@lo:400:kworker.0 Request processed in 34us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587254.279655:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788587254.279921:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208235648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587254.279935:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875469208236160:0@lo:400:kworker.0 00000100:00100000:1.0:1788587254.443964:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587254.444174:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182035328 00000100:00100000:0.0:1788587254.444185:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182035328 00000100:00100000:0.0:1788587254.444285:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:0.0:1788587254.444296:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14502:x1875469182035328:12345-192.168.204.28@tcp:101:cat.0 00010000:00010000:0.0:1788587254.444322:0:16597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587254.444348:0:16597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a00c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c3d expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.444475:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a013 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.444490:0:16597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.444502:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a013 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587254.444528:0:16597:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788587254.444677:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a00c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c3d expref: 22 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.444697:0:16597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a013 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c3d expref: 21 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.444705:0:16597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587254.444708:0:16597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587254.444711:0:16597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587254.444780:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+21:14502:x1875469182035328:12345-192.168.204.28@tcp:101:cat.0 Request processed in 485us (836us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788587254.444787:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00080000:1.0:1788587254.447424:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587254.465711:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587254.465780:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587254.465879:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182035712 00000100:00100000:2.0:1788587254.465891:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182035712 00000100:00100000:2.0:1788587254.465977:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:2.0:1788587254.465987:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+21:2362:x1875469182035712:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587254.466004:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587254.466035:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a013 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c3d expref: 21 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.466055:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:2.0:1788587254.466061:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587254.466122:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:2362:x1875469182035712:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 137us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587254.466129:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 1 00000100:00100000:0.0:1788587254.467718:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182035584 00000100:00100000:0.0:1788587254.467728:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182035584 00000100:00100000:0.0:1788587254.467795:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:0.0:1788587254.467804:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:14502:x1875469182035584:12345-192.168.204.28@tcp:35:cat.0 00000100:00100000:0.0:1788587254.468193:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+21:14502:x1875469182035584:12345-192.168.204.28@tcp:35:cat.0 Request processed in 389us (2493us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788587254.468208:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 8 00000100:00100000:1.0:1788587254.577206:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587254.577574:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182035968 00000100:00100000:0.0:1788587254.577588:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182035968 00000100:00100000:0.0:1788587254.577654:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:0.0:1788587254.577666:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+21:14508:x1875469182035968:12345-192.168.204.28@tcp:101:dd.0 00010000:00010000:0.0:1788587254.577704:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587254.577743:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a021 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c44 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.577954:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a028 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.577970:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a028 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.577983:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a028 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587254.577999:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788587254.578158:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a021 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c44 expref: 24 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.578175:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a028 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c44 expref: 23 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.578184:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587254.578188:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587254.578191:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587254.578560:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14508:x1875469182035968:12345-192.168.204.28@tcp:101:dd.0 Request processed in 895us (1363us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788587254.578568:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:1.0:1788587254.589279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587254.589485:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182036224 00000100:00100000:3.0:1788587254.589496:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182036224 00000100:00100000:3.0:1788587254.589577:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 35 00000100:00100000:3.0:1788587254.589599:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14508:x1875469182036224:12345-192.168.204.28@tcp:36:dd.0 00010000:00010000:3.0:1788587254.589690:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788587254.589723:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a028 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c44 expref: 23 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.589748:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab89fdb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c28 expref: 22 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.589771:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:3.0:1788587254.589777:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788587254.590135:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.590149:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.590161:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587254.590225:0:14449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788587254.590252:0:14449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e7e5cea reply state 00000000cd48fde0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587254.590261:0:14449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587254.590966:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14508:x1875469182036224:12345-192.168.204.28@tcp:36:dd.0 Request processed in 1375us (1694us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788587254.590975:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 35 00000020:00080000:3.0:1788587254.590981:0:14449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788587254.595519:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.595539:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.595567:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.595573:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587254.595577:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.595586:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.595605:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587254.595608:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587254.595614:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587254.595621:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5000/0xc1a730b05ab8a036 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587254.650802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587254.650915:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182036480 00000100:00100000:0.0:1788587254.650926:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182036480 00000100:00100000:0.0:1788587254.651000:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:0.0:1788587254.651011:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14508:x1875469182036480:12345-192.168.204.28@tcp:35:dd.0 00000100:00100000:0.0:1788587254.651286:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14508:x1875469182036480:12345-192.168.204.28@tcp:35:dd.0 Request processed in 276us (497us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1788587254.651294:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 9 00000100:00100000:1.0:1788587254.792475:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587254.792556:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182036608 00000100:00100000:2.0:1788587254.792568:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182036608 00000100:00100000:2.0:1788587254.792637:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:2.0:1788587254.792650:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14522:x1875469182036608:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:2.0:1788587254.792694:0:16533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587254.792719:0:16533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8a03d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c4b expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792792:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792807:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792819:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792834:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792840:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792873:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792969:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a052 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792979:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.792986:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587254.793027:0:16533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788587254.793037:0:16533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788587254.793078:0:16533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793091:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a052 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793100:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793107:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793114:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793120:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587254.793124:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793131:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793142:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:2.0:1788587254.793146:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587254.793151:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793157:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a044 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793173:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793189:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793195:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793201:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587254.793204:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793210:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793218:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8baca0968e00) 00010000:00010000:2.0:1788587254.793221:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587254.793224:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793229:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a04b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793262:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8a03d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c4b expref: 26 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793276:0:16533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a052 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c4b expref: 25 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587254.793283:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:2.0:1788587254.793285:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587254.793295:0:16533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4400, rc 0) 00000100:00100000:2.0:1788587254.793365:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+25:14522:x1875469182036608:12345-192.168.204.28@tcp:101:stat.0 Request processed in 718us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587254.793373:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 36 00000100:00100000:0.0:1788587254.793605:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788587254.793622:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208236544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788587254.793668:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587254.796034:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208236544 00000100:00100000:3.0:1788587254.796051:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208236544 00000100:00100000:3.0:1788587254.796098:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788587254.796109:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208236544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788587254.796145:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788587254.796218:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875469208236544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587254.796225:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788587254.799096:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875469208236544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788587254.871889:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587254.871941:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182036864 00000100:00100000:1.0:1788587254.871960:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182036864 00000100:00100000:1.0:1788587254.872036:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 37 00000100:00100000:1.0:1788587254.872046:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+25:14528:x1875469182036864:12345-192.168.204.28@tcp:36:truncate.0 00010000:00010000:1.0:1788587254.872119:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788587254.872154:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4400/0xc1a730b05ab8a052 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c4b expref: 25 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587254.872178:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:1.0:1788587254.872185:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788587254.872475:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587254.872492:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587254.872504:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587254.872557:0:14448:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1788587254.872583:0:14448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a5d8087 reply state 00000000bd162342 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587254.872606:0:14448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788587254.882911:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+27:14528:x1875469182036864:12345-192.168.204.28@tcp:36:truncate.0 Request processed in 10855us (11025us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788587254.882924:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 37 00000020:00080000:1.0:1788587254.882931:0:14448:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788587254.912185:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.912214:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.912222:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.912228:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbeed3a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587254.912233:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.912242:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.912262:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:3.0:1788587254.912265:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587254.912270:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587254.912276:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbeed3a00/0xc1a730b05ab8a059 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788587254.912873:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:1.0:1788587254.912902:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788587255.093165:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.093367:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182036992 00000100:00100000:3.0:1788587255.093378:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182036992 00000100:00100000:3.0:1788587255.093459:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 38 00000100:00100000:3.0:1788587255.093471:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+12:14542:x1875469182036992:12345-192.168.204.28@tcp:101:stat.0 00010000:00010000:3.0:1788587255.093498:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587255.093518:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a060 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c52 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.093602:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.093618:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.093630:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.093651:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.093659:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.093666:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.094115:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.094125:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.094133:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587255.094172:0:14449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788587255.094176:0:14449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587255.095039:0:14449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095070:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095080:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095086:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095093:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095099:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587255.095103:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095111:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095125:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:3.0:1788587255.095127:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587255.095132:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095139:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a067 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095155:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095162:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095173:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095178:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587255.095181:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095198:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095206:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8bac987bc600) 00010000:00010000:3.0:1788587255.095209:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587255.095211:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095217:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a06e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095257:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a060 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 14 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095270:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.095276:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:3.0:1788587255.095278:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788587255.095281:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c5a00, rc 0) 00000100:00100000:3.0:1788587255.095978:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+13:14542:x1875469182036992:12345-192.168.204.28@tcp:101:stat.0 Request processed in 2506us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587255.095998:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 38 00010000:00010000:1.0:1788587255.107239:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587255.185553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.185640:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182037248 00000100:00100000:0.0:1788587255.185650:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182037248 00000100:00100000:0.0:1788587255.185705:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:0.0:1788587255.185713:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+13:14552:x1875469182037248:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:0.0:1788587255.185732:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587255.185751:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a07c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c59 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587255.185837:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788587255.186220:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a07c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c59 expref: 15 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.186237:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:0.0:1788587255.186240:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788587255.186246:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a07c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c59 expref: 15 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.186263:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99e00, rc 0) 00000100:00100000:0.0:1788587255.186328:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+14:14552:x1875469182037248:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 615us (784us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1788587255.186336:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 39 00000100:00100000:1.0:1788587255.189123:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.189259:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182037504 00000100:00100000:0.0:1788587255.189271:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182037504 00000100:00100000:0.0:1788587255.189409:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:0.0:1788587255.189423:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac889c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+14:14552:x1875469182037504:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587255.189750:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac889c2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:14552:x1875469182037504:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 328us (638us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788587255.189773:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 10 00000100:00100000:1.0:1788587255.270624:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.272888:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182037760 00000100:00100000:0.0:1788587255.272907:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182037760 00000100:00100000:0.0:1788587255.273001:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:0.0:1788587255.273013:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:14558:x1875469182037760:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1788587255.273046:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587255.273071:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a08a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c60 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.273203:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.273220:0:14448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.273228:0:14448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.273237:0:14448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.273280:0:14448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 16 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.273294:0:14448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 16 pid: 14449 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.273308:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14448:1875469208236672:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587255.273519:0:14448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.273529:0:14448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 16 pid: 14447 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.273551:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14448:1875469208236800:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587255.273577:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788587255.276781:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14448:1875469208236672:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587255.276799:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14448:1875469208236800:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587255.276825:0:14448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587255.282458:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587255.282511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.282628:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182037888 00000100:00100000:2.0:1788587255.282638:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182037888 00010000:00010000:2.0:1788587255.282697:0:14433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 17 pid: 14449 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.282784:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182038016 00000100:00100000:2.0:1788587255.282788:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182038016 00010000:00010000:2.0:1788587255.282802:0:14433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 18 pid: 14447 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.282989:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1788587255.283006:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac831aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:2361:x1875469182037888:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587255.283026:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587255.283035:0:14434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 18 pid: 14449 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283051:0:14434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 18 pid: 14449 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283085:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5a00/0xc1a730b05ab8a075 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c52 expref: 18 pid: 14449 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283109:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587255.283140:0:14434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283151:0:14434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283161:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587255.283232:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac831aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:2361:x1875469182037888:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 230us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.283240:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:0.0:1788587255.283306:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:0.0:1788587255.283313:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+16:2361:x1875469182038016:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587255.283321:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587255.283326:0:14434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 16 pid: 14447 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283337:0:14434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 16 pid: 14447 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283350:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4200/0xc1a730b05ab89fc6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c21 expref: 16 pid: 14447 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283361:0:14434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587255.283364:0:14434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283373:0:14434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283391:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283435:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587255.283458:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:2361:x1875469182038016:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 145us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.283465:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00010000:00010000:0.0:1788587255.283490:0:14448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283503:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587255.283524:0:14448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788587255.283747:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a08a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 16 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283764:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 15 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.283771:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587255.283774:0:14448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788587255.283776:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacc1a99000, rc 0) 00000100:00100000:0.0:1788587255.283808:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:14558:x1875469182037760:12345-192.168.204.28@tcp:101:bash.0 Request processed in 10798us (13197us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788587255.283816:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 40 00000100:00100000:1.0:1788587255.287655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.288060:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182038272 00000100:00100000:3.0:1788587255.288070:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182038272 00000100:00100000:3.0:1788587255.288163:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 41 00000100:00100000:3.0:1788587255.288174:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:14558:x1875469182038272:12345-192.168.204.28@tcp:36:bash.0 00010000:00010000:3.0:1788587255.288506:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.288526:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.288538:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587255.288597:0:14449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788587255.288622:0:14449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000efcde4c reply state 00000000f4f3500f transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587255.288631:0:14449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788587255.288816:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14558:x1875469182038272:12345-192.168.204.28@tcp:36:bash.0 Request processed in 643us (1168us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788587255.288824:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 41 00000020:00080000:3.0:1788587255.288828:0:14449:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788587255.291646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00010000:00010000:0.0:1788587255.291733:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.291762:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.291771:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.291778:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587255.291783:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.291791:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.291810:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587255.291813:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587255.291818:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.291824:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5400/0xc1a730b05ab8a09f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.292011:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182038400 00000100:00100000:2.0:1788587255.292023:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182038400 00000100:00100000:2.0:1788587255.292076:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:2.0:1788587255.292087:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14558:x1875469182038400:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587255.292110:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587255.292128:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8a0a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c67 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.292194:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8a0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c67 expref: 18 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.292208:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8a0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c67 expref: 18 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.292227:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:2.0:1788587255.292237:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587255.292240:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5800, rc 0) 00000100:00100000:2.0:1788587255.292753:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14558:x1875469182038400:12345-192.168.204.28@tcp:101:bash.0 Request processed in 665us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.292761:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 42 00000100:00100000:1.0:1788587255.297910:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.298010:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182038528 00000100:00100000:0.0:1788587255.298021:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182038528 00000100:00100000:0.0:1788587255.298078:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:0.0:1788587255.298089:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14558:x1875469182038528:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:0.0:1788587255.298110:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587255.298130:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a0ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c6e expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.298298:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.298320:0:14448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.298394:0:14448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.298451:0:14448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.298466:0:14448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 19 pid: 14448 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.298482:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14448:1875469208236928:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587255.298611:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788587255.301203:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14448:1875469208236928:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587255.301232:0:14448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587255.301294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.301353:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182038656 00000100:00100000:2.0:1788587255.301373:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182038656 00010000:00010000:2.0:1788587255.301413:0:14433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 20 pid: 14448 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.301507:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:2.0:1788587255.301518:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:2362:x1875469182038656:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587255.301546:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587255.301555:0:14433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 20 pid: 14448 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.301573:0:14433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 20 pid: 14448 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.301597:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99000/0xc1a730b05ab8a091 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c60 expref: 20 pid: 14448 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.301660:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:2.0:1788587255.301666:0:14433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.301676:0:14433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.301702:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.301917:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587255.302030:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:2362:x1875469182038656:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 513us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.302039:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00010000:00010000:0.0:1788587255.302051:0:14448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.302058:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587255.302108:0:14448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788587255.302113:0:14448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587255.302135:0:14448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.302193:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacc1a99e00/0xc1a730b05ab8a0ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c6e expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.302210:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c6e expref: 18 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.302217:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:0.0:1788587255.302220:0:14448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788587255.302223:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacaef8d600, rc 0) 00000100:00100000:0.0:1788587255.302260:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14558:x1875469182038528:12345-192.168.204.28@tcp:101:bash.0 Request processed in 4174us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.302276:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 43 00000100:00100000:1.0:1788587255.307045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.307116:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182038912 00000100:00100000:3.0:1788587255.307130:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182038912 00000100:00100000:3.0:1788587255.307213:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:3.0:1788587255.307224:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14558:x1875469182038912:12345-192.168.204.28@tcp:103:bash.0 00010000:00010000:3.0:1788587255.307241:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788587255.307281:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d600/0xc1a730b05ab8a0b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c6e expref: 18 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.307305:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5800/0xc1a730b05ab8a0a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c67 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.307316:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc700) 00010000:00010000:3.0:1788587255.307328:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788587255.307382:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfaddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+16:14558:x1875469182038912:12345-192.168.204.28@tcp:103:bash.0 Request processed in 160us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587255.307390:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 2 00000100:00100000:1.0:1788587255.312250:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.312334:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182039040 00000100:00100000:3.0:1788587255.312356:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182039040 00000100:00100000:3.0:1788587255.312473:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:3.0:1788587255.312485:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+16:14558:x1875469182039040:12345-192.168.204.28@tcp:58:bash.0 00010000:00010000:3.0:1788587255.312598:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.312618:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.312631:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788587255.313419:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788587255.313588:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788587255.313661:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788587255.313764:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+16:14558:x1875469182039040:12345-192.168.204.28@tcp:58:bash.0 Request processed in 1277us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587255.313783:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 44 00000100:00100000:1.0:1788587255.317099:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.317481:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182039168 00000100:00100000:2.0:1788587255.317492:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182039168 00000100:00100000:2.0:1788587255.317702:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 45 00000100:00100000:2.0:1788587255.317715:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+16:14558:x1875469182039168:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:2.0:1788587255.317739:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587255.317764:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c75 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.317823:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.317834:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c75 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.320240:0:14447:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.320270:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c75 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.320286:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587255.320303:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587255.320307:0:14447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c75 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.320317:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5400, rc 0) 00000100:00100000:2.0:1788587255.320512:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbfadea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14558:x1875469182039168:12345-192.168.204.28@tcp:101:bash.0 Request processed in 2799us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.320520:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 45 00000040:00080000:3.0:1788587255.683250:0:14481:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788587255.683259:0:14481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587255.683320:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788587255.683341:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788587255.683493:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacb44fb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14481:1875469208237056:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788587255.683605:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98081d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587255.687903:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacb44fb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14481:1875469208237056:192.168.204.28@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788587255.688548:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.688695:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182039296 00000100:00100000:3.0:1788587255.688703:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182039296 00000100:00100000:3.0:1788587255.688755:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:3.0:1788587255.688765:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182039296:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788587255.688873:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182039296:12345-192.168.204.28@tcp:900:lhsmtool_posix.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587255.688882:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 0 00000100:00100000:1.0:1788587255.702595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.705619:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182039424 00000100:00100000:0.0:1788587255.705637:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182039424 00000100:00100000:0.0:1788587255.705735:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:0.0:1788587255.705747:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182039424:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788587255.705785:0:14448:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788587255.707339:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182039424:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 1575us (4744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.707351:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 46 00000100:00100000:1.0:1788587255.713313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.713549:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182039552 00000100:00100000:3.0:1788587255.713561:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182039552 00000100:00100000:3.0:1788587255.713622:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:3.0:1788587255.713633:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182039552:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788587255.713716:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713733:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713746:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713818:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713827:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713835:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713892:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713902:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713910:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788587255.713952:0:14449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788587255.713956:0:14449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788587255.713971:0:14449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713982:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713988:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.713996:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714011:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4000 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587255.714015:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714024:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714036:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bacc216c800) 00010000:00010000:3.0:1788587255.714039:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587255.714043:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714050:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4000/0xc1a730b05ab8a0c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714062:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714068:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714074:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714079:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587255.714082:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714088:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714102:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8bac987bc700) 00010000:00010000:3.0:1788587255.714105:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587255.714108:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714114:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a0d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714128:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714133:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714138:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714143:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587255.714146:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714152:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714159:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587255.714161:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587255.714164:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.714170:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587255.714256:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182039552:12345-192.168.204.28@tcp:34:lhsmtool_posix.0 Request processed in 625us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587255.714264:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 47 00000100:00100000:3.0:1788587255.716451:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.717912:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182039808 00000100:00100000:2.0:1788587255.717930:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182039808 00000100:00100000:2.0:1788587255.718182:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:2.0:1788587255.718194:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182039808:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587255.718219:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587255.718240:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c7c expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.718759:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.718776:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.718789:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587255.718802:0:14447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788587255.719768:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.719783:0:14447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.719809:0:14447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.719816:0:14447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587255.719822:0:14447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.719831:0:14447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.721871:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:2.0:1788587255.721881:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788587255.721890:0:14447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.721901:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a0e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.721992:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0de lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c7c expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.722005:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8bacc216c800) 00010000:00010000:2.0:1788587255.722007:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587255.722012:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c7c expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.722023:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5200, rc 0) 00000100:00100000:2.0:1788587255.722118:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14559:x1875469182039808:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 3926us (5678us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788587255.722145:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 48 00000100:00100000:1.0:1788587255.733138:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.733285:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182039936 00000100:00100000:2.0:1788587255.733296:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182039936 00000100:00100000:2.0:1788587255.733374:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:2.0:1788587255.733385:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14559:x1875469182039936:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788587255.733433:0:16533:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788587255.733794:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14559:x1875469182039936:12345-192.168.204.28@tcp:53:lhsmtool_posix.0 Request processed in 408us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.733802:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 49 00000100:00100000:1.0:1788587255.739563:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.739935:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182040192 00000100:00100000:3.0:1788587255.739949:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182040192 00000100:00100000:3.0:1788587255.740499:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:3.0:1788587255.740516:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+18:14559:x1875469182040192:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788587255.740540:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587255.740566:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c83 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788587255.742731:0:14449:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1788587255.742744:0:14449:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788587255.742803:0:14449:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788587255.743143:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.743161:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.743174:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.743314:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c5e00/0xc1a730b05ab8a0f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c83 expref: 21 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.743335:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c83 expref: 20 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.743344:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968e00) 00010000:00010000:2.0:1788587255.743354:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788587255.743358:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5200, rc 0) 00000100:00100000:2.0:1788587255.743437:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:14559:x1875469182040192:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 2926us (3887us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788587255.743447:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 50 00000100:00100000:3.0:1788587255.746991:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.747675:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182040448 00000100:00100000:2.0:1788587255.747688:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182040448 00000100:00100000:2.0:1788587255.747760:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:2.0:1788587255.747772:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:14559:x1875469182040448:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587255.747873:0:14447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587255.747912:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a0fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c83 expref: 20 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.747938:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968e00) 00010000:00010000:2.0:1788587255.747954:0:14447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587255.747984:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.747998:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.748574:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.748594:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.748603:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.748694:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.748992:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749071:0:14447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749079:0:14447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749086:0:14447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587255.749090:0:14447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749099:0:14447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749110:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:2.0:1788587255.749113:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587255.749117:0:14447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749124:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a108 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749136:0:14447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749142:0:14447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749155:0:14447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749160:0:14447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587255.749162:0:14447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749169:0:14447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749177:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xdcb6e06d (ffff8baca0968200) 00010000:00010000:2.0:1788587255.749180:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587255.749183:0:14447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.749189:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a10f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xdcb6e06d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.749621:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14559:x1875469182040448:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 1838us (2626us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788587255.749630:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 51 00000100:00100000:0.0:1788587255.756584:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.756678:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182040576 00000100:00100000:2.0:1788587255.756687:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182040576 00000100:00100000:2.0:1788587255.756744:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:2.0:1788587255.756754:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14559:x1875469182040576:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587255.756775:0:16533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587255.756799:0:16533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a116 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c8a expref: -99 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.756871:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a11d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.756885:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.756895:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a11d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.756994:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a116 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c8a expref: 21 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.757012:0:16533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4800/0xc1a730b05ab8a11d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c8a expref: 20 pid: 16533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.757020:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:2.0:1788587255.757023:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788587255.757026:0:16533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4800, rc 0) 00000100:00100000:2.0:1788587255.757087:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:14559:x1875469182040576:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 335us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.757094:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 52 00000100:00100000:1.0:1788587255.776048:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.776176:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182040832 00000100:00100000:2.0:1788587255.776188:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182040832 00000100:00100000:2.0:1788587255.776266:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 53 00000100:00100000:2.0:1788587255.776277:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+20:14559:x1875469182040832:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587255.776378:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.776427:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.776439:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788587255.776947:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788587255.776959:0:14449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 577981115873ns, next at 578981113038ns, rc = 0 00000004:00010000:2.0:1788587255.777057:0:14449:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d33b8af reply state 00000000b897865c transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.777067:0:14449:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587255.777186:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+22:14559:x1875469182040832:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 909us (1146us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788587255.777194:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 53 00010000:00010000:0.0:1788587255.785822:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.785854:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.785887:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.785893:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d5e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587255.785898:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.785907:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.785926:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:0.0:1788587255.785929:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788587255.785934:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.785940:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5e00/0xc1a730b05ab8a124 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788587255.791459:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.792311:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182040960 00000100:00100000:2.0:1788587255.792323:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182040960 00000100:00100000:2.0:1788587255.792389:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:2.0:1788587255.792411:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+21:14559:x1875469182040960:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587255.792458:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587255.792482:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c91 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.792546:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 22 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.792562:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 22 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.792602:0:14447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:2.0:1788587255.792605:0:14447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788587255.792610:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5200, rc 0) 00000100:00100000:2.0:1788587255.792679:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+22:14559:x1875469182040960:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 270us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.792686:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 54 00000100:00100000:3.0:1788587255.799141:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.800823:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182041088 00000100:00100000:2.0:1788587255.800840:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182041088 00000100:00080000:1.0:1788587255.801339:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587255.802536:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:2.0:1788587255.802557:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2360:x1875469182041088:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788587255.803084:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2360:x1875469182041088:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 535us (3953us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788587255.803093:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:2.0:1788587255.814133:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587255.814720:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182041344 00000100:00100000:1.0:1788587255.814731:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182041344 00000100:00100000:1.0:1788587255.814820:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1788587255.814830:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+22:14559:x1875469182041344:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788587255.815112:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14559:x1875469182041344:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 283us (986us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788587255.815120:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 11 00000100:00100000:1.0:1788587255.825397:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.826512:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182041600 00000100:00100000:0.0:1788587255.826529:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182041600 00000100:00100000:1.0:1788587255.826727:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:1.0:1788587255.826751:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14559:x1875469182041600:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788587255.826916:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14559:x1875469182041600:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 171us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587255.826924:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 55 00000100:00100000:3.0:1788587255.831648:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.831756:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182041728 00000100:00100000:0.0:1788587255.831766:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182041728 00000100:00100000:0.0:1788587255.831825:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:0.0:1788587255.831836:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14559:x1875469182041728:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788587255.831894:0:16597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788587255.831919:0:16597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a132 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c98 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.832029:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8ca00/0xc1a730b05ab8a139 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.832051:0:16597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8ca00/0xc1a730b05ab8a139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.832066:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8ca00/0xc1a730b05ab8a139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788587255.832110:0:16597:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788587255.832133:0:16597:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8ca00/0xc1a730b05ab8a139 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16597 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.832160:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a132 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c98 expref: 25 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.832190:0:16597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8ca00/0xc1a730b05ab8a139 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c98 expref: 24 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.832199:0:16597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:0.0:1788587255.832202:0:16597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788587255.832205:0:16597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacaef8ca00, rc 0) 00000100:00100000:0.0:1788587255.832282:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14559:x1875469182041728:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 448us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.832289:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 56 00000100:00100000:0.0:1788587255.839380:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587255.839555:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182041856 00000100:00100000:1.0:1788587255.839567:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182041856 00000100:00100000:1.0:1788587255.839658:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:1.0:1788587255.839668:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+6:2361:x1875469182041856:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788587255.839689:0:15130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788587255.839713:0:15130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2c9f expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788587255.839743:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bacf7, blocks: 0x1 00010000:00010000:1.0:1788587255.839767:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=578s v=(0 0) 00010000:00010000:1.0:1788587255.839774:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788587255.839785:0:15130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 7 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587255.839805:0:15130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 7 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587255.839820:0:15130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbeed3400, rc 0) 00000100:00100000:1.0:1788587255.839906:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2361:x1875469182041856:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 239us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587255.839932:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:3.0:1788587255.851098:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.851235:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182042112 00000100:00100000:0.0:1788587255.851248:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182042112 00000100:00100000:0.0:1788587255.851373:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:0.0:1788587255.851387:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14559:x1875469182042112:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788587255.851523:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14559:x1875469182042112:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 140us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.851545:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 57 00000100:00100000:3.0:1788587255.862966:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.863197:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182042240 00000100:00100000:0.0:1788587255.863208:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182042240 00000100:00100000:0.0:1788587255.863268:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 58 00000100:00100000:0.0:1788587255.863278:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14559:x1875469182042240:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788587255.919086:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+24:14559:x1875469182042240:12345-192.168.204.28@tcp:44:lhsmtool_posix.0 Request processed in 55798us (56120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.919098:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 58 00000001:00080000:3.0:1788587255.919181:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000001:00080000:3.0:1788587255.919205:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788587255.919219:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788587255.919558:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587255.919577:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208237184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788587255.919648:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587255.919713:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208237184 00000100:00100000:2.0:1788587255.919721:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208237184 00000100:00100000:2.0:1788587255.919763:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788587255.919772:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208237184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788587255.919969:0:15133:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788587255.919973:0:15133:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788587255.919976:0:15133:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788587255.919978:0:15133:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788587255 -> 1788587255 00002000:00010000:2.0:1788587255.919980:0:15133:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788587255.920014:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875469208237184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (366us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788587255.920020:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788587255.920062:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bab829ee300/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788587255.920068:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208237184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788587255.923531:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.923724:0:16596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182042368 00000100:00100000:0.0:1788587255.923736:0:16596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182042368 00000100:00100000:0.0:1788587255.923898:0:16596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:0.0:1788587255.923911:0:16596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2361:x1875469182042368:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788587255.924043:0:16596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2361:x1875469182042368:12345-192.168.204.28@tcp:16:lhsmtool_posix.0 Request processed in 135us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.924050:0:16596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:3.0:1788587255.926583:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.926819:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182042624 00000100:00100000:2.0:1788587255.926830:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182042624 00000100:00100000:2.0:1788587255.926913:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 59 00000100:00100000:2.0:1788587255.926922:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+13:14559:x1875469182042624:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788587255.926977:0:14448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587255.927006:0:14448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8ca00/0xc1a730b05ab8a139 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c98 expref: 13 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.927033:0:14448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:2.0:1788587255.927040:0:14448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788587255.927081:0:14448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.927096:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.927107:0:14448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788587255.927348:0:14448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ecd4075 reply state 000000007c8711ad transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.927358:0:14448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788587255.927475:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+14:14559:x1875469182042624:12345-192.168.204.28@tcp:36:lhsmtool_posix.0 Request processed in 553us (904us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788587255.927482:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 59 00010000:00010000:2.0:1788587255.930877:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.930895:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.930901:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.930918:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacbf9d4600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:2.0:1788587255.930923:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.930931:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.930949:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:2.0:1788587255.930952:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788587255.930957:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.930963:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a147 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587255.932048:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.932270:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182042752 00000100:00100000:2.0:1788587255.932281:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182042752 00000100:00100000:2.0:1788587255.932350:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:2.0:1788587255.932361:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:14559:x1875469182042752:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788587255.932383:0:15133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587255.932408:0:15133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2ca6 expref: -99 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.932460:0:15133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 8 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.932470:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587255.932476:0:15133:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788587255.932482:0:15133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 8 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.932523:0:15133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 8 pid: 15130 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.932538:0:15133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 8 pid: 15130 timeout: 678 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.932554:0:15133:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bab829ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15133:1875469208237312:192.168.204.28@tcp:104: 00000100:00100000:2.0:1788587255.932647:0:15133:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac86004a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788587255.938999:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.939119:0:15133:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bab829ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15133:1875469208237312:192.168.204.28@tcp:104: 00010000:00010000:2.0:1788587255.939153:0:15133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 8 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.939187:0:15133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d5800, rc 0) 00000100:00100000:2.0:1788587255.939256:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+8:14559:x1875469182042752:12345-192.168.204.28@tcp:101:lhsmtool_posix.0 Request processed in 6897us (7215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.939265:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:0.0:1788587255.939369:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182042880 00000100:00100000:0.0:1788587255.939377:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182042880 00010000:00010000:0.0:1788587255.939428:0:14433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 8 pid: 15130 timeout: 678 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.939465:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:0.0:1788587255.939474:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+8:2362:x1875469182042880:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788587255.939491:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788587255.939514:0:14433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 8 pid: 15130 timeout: 678 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.939527:0:14433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 8 pid: 15130 timeout: 678 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.939570:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685eb720/0xc1a730b05ab8a140 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c9f expref: 8 pid: 15130 timeout: 678 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.939585:0:14433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587255.939590:0:14433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587255.939597:0:14433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 7 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.939609:0:14433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 7 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.939663:0:14433:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 7 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.939677:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14433:1875469208237440:192.168.204.28@tcp:105: 00000100:00100000:0.0:1788587255.939737:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788587255.944969:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14433:1875469208237440:192.168.204.28@tcp:105: 00010000:00010000:0.0:1788587255.944998:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788587255.945059:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2362:x1875469182042880:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 5585us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.945069:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:3.0:1788587255.947202:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587255.947304:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182043008 00000100:00100000:1.0:1788587255.947328:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182043008 00000100:00100000:1.0:1788587255.947391:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:1.0:1788587255.947402:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2362:x1875469182043008:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788587255.947634:0:15130:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788587255.947638:0:15130:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788587255 00002000:00010000:1.0:1788587255.947640:0:15130:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788587253 00002000:00010000:1.0:1788587255.947642:0:15130:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788587255 -> 1788587255 00002000:00010000:1.0:1788587255.947644:0:15130:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788587255.947705:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+8:2362:x1875469182043008:12345-192.168.204.28@tcp:2:lhsmtool_posix.0 Request processed in 304us (510us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788587255.947713:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 17 00000100:00100000:3.0:1788587255.952340:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.952469:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182043136 00000100:00100000:0.0:1788587255.952479:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182043136 00000100:00100000:0.0:1788587255.952535:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:0.0:1788587255.952551:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+8:2360:x1875469182043136:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788587255.952598:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.952622:0:15132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 8 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.952644:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788587255.952649:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788587255.952654:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.952690:0:15132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 8 pid: 15133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.952704:0:15132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 8 pid: 15133 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.952720:0:15132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15132:1875469208237568:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587255.952799:0:15132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587255.957461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587255.957563:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182043264 00000100:00100000:2.0:1788587255.957574:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182043264 00010000:00010000:2.0:1788587255.957617:0:14434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 9 pid: 15133 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.957667:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:2.0:1788587255.957678:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:2361:x1875469182043264:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587255.957694:0:14434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587255.957716:0:14434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 9 pid: 15133 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.957731:0:14434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 9 pid: 15133 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.957757:0:14434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587255.957761:0:14434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788587255.957768:0:14434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.957797:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.957821:0:14434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587255.957904:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+9:2361:x1875469182043264:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 227us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.957921:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00010000:00010000:0.0:1788587255.958900:0:15132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081946f20/0xc1a730b05ab8a14e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2ca6 expref: 8 pid: 15133 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.958932:0:15132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15132:1875469208237568:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587255.958955:0:15132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.958979:0:15132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.958987:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.959017:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.959026:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.959034:0:15132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.959041:0:15132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacaef8d200 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:0.0:1788587255.959046:0:15132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.959055:0:15132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.959070:0:15132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.959089:0:15132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aed87a2a/0xc1a730b05ab8a155 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.959164:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:2360:x1875469182043136:12345-192.168.204.28@tcp:1:lhsmtool_posix.0 Request processed in 6614us (6844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587255.959180:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 18 00000100:00100000:3.0:1788587255.963839:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.963984:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182043520 00000100:00100000:0.0:1788587255.963994:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182043520 00000100:00100000:0.0:1788587255.964050:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 60 00000100:00100000:0.0:1788587255.964060:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+13:14559:x1875469182043520:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788587255.964152:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.964181:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.964194:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.964498:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.964511:0:16533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 14 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.964519:0:16533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.964565:0:16533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 14 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.964580:0:16533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 14 pid: 14447 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.964595:0:16533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16533:1875469208237696:192.168.204.28@tcp:104: 00000100:00100000:0.0:1788587255.964675:0:16533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac85ae86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788587255.968922:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.969120:0:16533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16533:1875469208237696:192.168.204.28@tcp:104: 00010000:00010000:0.0:1788587255.969151:0:16533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.969430:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182043648 00000100:00100000:2.0:1788587255.969439:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182043648 00010000:00010000:2.0:1788587255.969491:0:14433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 15 pid: 14447 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788587255.969532:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 16 00000100:00100000:2.0:1788587255.969543:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacb44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+15:2362:x1875469182043648:12345-192.168.204.28@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788587255.969561:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788587255.969568:0:14433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 15 pid: 14447 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.969581:0:14433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 15 pid: 14447 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.969605:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5200/0xc1a730b05ab8a12b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c91 expref: 15 pid: 14447 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.969630:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:2.0:1788587255.969653:0:14433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.969665:0:14433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.969672:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587255.969705:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788587255.969765:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+14:2362:x1875469182043648:12345-192.168.204.28@tcp:103:ldlm_bl.0 Request processed in 223us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.969772:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 16 00010000:00010000:3.0:1788587255.971080:0:16533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.971095:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788587255.971295:0:16533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788587255.971483:0:16533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1788587255.971530:0:16533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1788587255.971640:0:16533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf49b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16533:1875469208237824:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788587255.971745:0:16533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587255.971782:0:16533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac98081540 going to sleep for 11 seconds 00000100:00100000:2.0:1788587255.972128:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208237824 00000100:00100000:2.0:1788587255.972135:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208237824 00000100:00100000:2.0:1788587255.972193:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788587255.972203:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16533:x1875469208237824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788587255.972329:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16533:x1875469208237824:12345-0@lo:1000:mdt00_003.0 Request processed in 127us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587255.972336:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788587255.972476:0:16533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf49b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16533:1875469208237824:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788587255.973172:0:16533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1788587255.973251:0:16533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf49b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16533:1875469208237952:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788587255.973294:0:16533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788587255.973341:0:16533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346600 going to sleep for 11 seconds 00000100:00100000:1.0:1788587255.973637:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208237952 00000100:00100000:1.0:1788587255.973644:0:14452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208237952 00000100:00100000:1.0:1788587255.973677:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788587255.973685:0:14452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16533:x1875469208237952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788587255.973891:0:14452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16533:x1875469208237952:12345-0@lo:1000:mdt00_003.0 Request processed in 206us (595us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788587255.973898:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788587255.974425:0:16533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf49b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16533:1875469208237952:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788587255.974538:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974550:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974557:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974579:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacaef8c800 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587255.974584:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974592:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974610:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:3.0:1788587255.974613:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587255.974620:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974740:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8c800/0xc1a730b05ab8a163 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974774:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974782:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974788:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974793:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4a00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587255.974796:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974804:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974824:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587255.974826:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788587255.974833:0:16533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c75 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974964:0:16533:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c75 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.974975:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c75 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.975032:0:16533:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d5400/0xc1a730b05ab8a0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2c75 expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587255.975046:0:16533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbf49ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16533:1875469208238080:192.168.204.28@tcp:105: 00000100:00100000:3.0:1788587255.975177:0:16533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bac90346240 going to sleep for 11 seconds 00000100:00100000:0.0:1788587255.979419:0:16533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbf49ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16533:1875469208238080:192.168.204.28@tcp:105: 00010000:00010000:0.0:1788587255.979462:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979477:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4a00/0xc1a730b05ab8a0bb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979514:0:16533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979530:0:16533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979543:0:16533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979575:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979582:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979588:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979594:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacaef8d200 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587255.979598:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979605:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979618:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587255.979621:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788587255.979635:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979641:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8d200/0xc1a730b05ab8a16a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979652:0:16533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979658:0:16533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979664:0:16533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979678:0:16533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacaef8dc00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:0.0:1788587255.979681:0:16533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979687:0:16533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979695:0:16533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:0.0:1788587255.979698:0:16533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788587255.979701:0:16533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.979707:0:16533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8dc00/0xc1a730b05ab8a15c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788587255.979993:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacb44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182043520:12345-192.168.204.28@tcp:57:lhsmtool_posix.0 Request processed in 15933us (16163us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788587255.980004:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 60 00000020:00080000:0.0:1788587255.980009:0:16533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788587255.980756:0:14481:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788587255.980763:0:14481:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788587255.980804:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788587255.980811:0:14481:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788587255.983267:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.983759:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182043776 00000100:00100000:3.0:1788587255.983768:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182043776 00000100:00100000:3.0:1788587255.983836:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:3.0:1788587255.983883:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14558:x1875469182043776:12345-192.168.204.28@tcp:49:bash.0 00000100:00100000:3.0:1788587255.984016:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14558:x1875469182043776:12345-192.168.204.28@tcp:49:bash.0 Request processed in 170us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587255.984043:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 12 00000100:00100000:1.0:1788587255.986254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587255.986335:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182044032 00000100:00100000:0.0:1788587255.986343:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182044032 00000100:00100000:0.0:1788587255.986395:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 13 00000100:00100000:0.0:1788587255.986405:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+17:14559:x1875469182044032:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788587255.987146:0:14451:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788587255.987249:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1788587255.987297:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.987316:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.987338:0:14451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.987348:0:14451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.987355:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.987361:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788587255.987378:0:14451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788587255.987473:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14559:x1875469182044032:12345-192.168.204.28@tcp:35:lhsmtool_posix.0 Request processed in 1067us (1225us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1788587255.987482:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 13 00000020:00080000:0.0:1788587255.987487:0:14451:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788587255.987985:0:14436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788587255.987994:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587255.988014:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bacaef8de00 already unused, calling callback (ffffffffc14994f0) 00010000:00010000:1.0:1788587255.988019:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587255.988027:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587255.988039:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8baca0968200) 00010000:00010000:1.0:1788587255.988042:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788587255.988048:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587255.988053:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacaef8de00/0xc1a730b05ab8a171 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14451 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788587255.988067:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587255.988069:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587255.988071:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587255.992059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587255.992138:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182044160 00000100:00100000:3.0:1788587255.992150:0:15130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182044160 00000100:00100000:3.0:1788587255.992971:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:3.0:1788587255.992988:0:15130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+7:14558:x1875469182044160:12345-192.168.204.28@tcp:101:bash.0 00010000:00010000:3.0:1788587255.993013:0:15130:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788587255.993039:0:15130:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b040d4b/0xc1a730b05ab8a178 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2cad expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788587255.993067:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9bacf7, atime: 0x6a9bacf5, ctime: 0x6a9bacf7, blocks: 0x1 00010000:00010000:3.0:1788587255.993088:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=578s v=(0 0) 00010000:00010000:3.0:1788587255.993094:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788587255.993106:0:15130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b040d4b/0xc1a730b05ab8a178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2cad expref: 8 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.993124:0:15130:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b040d4b/0xc1a730b05ab8a178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2cad expref: 8 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587255.993138:0:15130:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bac829c4000, rc 0) 00000100:00100000:3.0:1788587255.994587:0:15130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+8:14558:x1875469182044160:12345-192.168.204.28@tcp:101:bash.0 Request processed in 1601us (2535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587255.994597:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 19 00000100:00100000:1.0:1788587256.000954:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587256.001075:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182044416 00000100:00100000:0.0:1788587256.001085:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182044416 00000100:00100000:0.0:1788587256.001148:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 14 00000100:00100000:0.0:1788587256.001159:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+19:14558:x1875469182044416:12345-192.168.204.28@tcp:35:bash.0 00000001:00080000:0.0:1788587256.001580:0:14451:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:0.0:1788587256.001767:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+21:14558:x1875469182044416:12345-192.168.204.28@tcp:35:bash.0 Request processed in 609us (823us total) trans 8589934632 rc 0/0 00000100:00100000:0.0:1788587256.001775:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 14 00000020:00080000:0.0:1788587256.001781:0:14451:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1788587256.002620:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587256.100435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587256.100540:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182044672 00000100:00100000:2.0:1788587256.100553:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182044672 00000100:00100000:2.0:1788587256.100628:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:2.0:1788587256.100640:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+21:14569:x1875469182044672:12345-192.168.204.28@tcp:101:lfs.0 00010000:00010000:2.0:1788587256.100666:0:16597:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788587256.100688:0:16597:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a17f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x825b6cbfb05c2cb4 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788587256.100791:0:16597:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788587256.101014:0:16597:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a17f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2cb4 expref: 23 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587256.101031:0:16597:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8bac987bc500) 00010000:00010000:2.0:1788587256.101034:0:16597:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788587256.101040:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bacbf9d4600/0xc1a730b05ab8a17f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.28@tcp remote: 0x825b6cbfb05c2cb4 expref: 23 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788587256.101057:0:16597:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bacbf9d4600, rc 0) 00000100:00100000:2.0:1788587256.101133:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+22:14569:x1875469182044672:12345-192.168.204.28@tcp:101:lfs.0 Request processed in 496us (709us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1788587256.101140:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 61 00000100:00100000:2.0:1788587256.105501:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:3.0:1788587256.105585:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182044800 00000100:00100000:3.0:1788587256.105598:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182044800 00000100:00100000:3.0:1788587256.105663:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:3.0:1788587256.105674:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bab829ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+22:14569:x1875469182044800:12345-192.168.204.28@tcp:34:lfs.0 00010000:00010000:3.0:1788587256.105789:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.105812:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.105826:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.105873:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.105881:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.105889:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106300:0:14449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106310:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106318:0:14449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788587256.106370:0:14449:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106383:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106401:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106419:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106424:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4600 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587256.106430:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106438:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106451:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8bac90439600) 00010000:00010000:3.0:1788587256.106454:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587256.106460:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106465:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4600/0xc1a730b05ab8a18d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106479:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106484:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106489:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106494:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4400 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587256.106502:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106509:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106516:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8bac987bc300) 00010000:00010000:3.0:1788587256.106518:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587256.106521:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106526:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4400/0xc1a730b05ab8a194 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106540:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106546:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106552:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106556:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bac829c4e00 already unused, calling callback (ffffffffc1edd4f0) 00010000:00010000:3.0:1788587256.106559:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106565:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106571:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8bac987bc600) 00010000:00010000:3.0:1788587256.106574:0:14449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788587256.106583:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788587256.106588:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bac829c4e00/0xc1a730b05ab8a19b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788587256.106688:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bab829ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+22:14569:x1875469182044800:12345-192.168.204.28@tcp:34:lfs.0 Request processed in 1012us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788587256.106697:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 62 00000100:00100000:3.0:1788587256.109659:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587256.109755:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045056 00000100:00100000:0.0:1788587256.109766:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045056 00000100:00100000:0.0:1788587256.109884:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 15 00000100:00100000:0.0:1788587256.109895:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbf49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+22:14569:x1875469182045056:12345-192.168.204.28@tcp:35:lfs.0 00000100:00100000:0.0:1788587256.110193:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbf49aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:14569:x1875469182045056:12345-192.168.204.28@tcp:35:lfs.0 Request processed in 300us (544us total) trans 8589934634 rc 0/0 00000100:00100000:0.0:1788587256.110201:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 15 00010000:00010000:1.0:1788587256.131150:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788587257.154975:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788587257.381033:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587257.381074:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587257.381108:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:1.0:1788587257.381136:0:15133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045440 00000100:00100000:1.0:1788587257.381157:0:15133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045440 00000100:00100000:1.0:1788587257.381218:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00100000:1.0:1788587257.381245:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+8:2359:x1875469182045440:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587257.381582:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+8:2359:x1875469182045440:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 339us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587257.381591:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 23 00000100:00080000:1.0:1788587257.381615:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587257.386888:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045184 00000100:00100000:2.0:1788587257.386908:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045184 00000100:00100000:2.0:1788587257.386978:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:2.0:1788587257.386990:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2359:x1875469182045184:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587257.387076:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa5bf23d-9321-44c0-a194-3dd88f5eaaa3+13:2359:x1875469182045184:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 88us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587257.387084:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 123 00000100:00100000:1.0:1788587257.390702:0:16533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045312 00000100:00100000:1.0:1788587257.390719:0:16533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045312 00000100:00100000:1.0:1788587257.390812:0:16533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:1.0:1788587257.390823:0:16533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:2359:x1875469182045312:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:1.0:1788587257.390944:0:16533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac8826ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+23:2359:x1875469182045312:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 124us (9835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788587257.390952:0:16533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 33 00000100:00100000:2.0:1788587257.400990:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587257.401029:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045696 00000100:00100000:2.0:1788587257.401038:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045696 00000100:00100000:2.0:1788587257.401101:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00100000:2.0:1788587257.401111:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2360:x1875469182045696:12345-192.168.204.28@tcp:400:kworker.0 00000100:00100000:2.0:1788587257.401199:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+6:2360:x1875469182045696:12345-192.168.204.28@tcp:400:kworker.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587257.401216:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 34 00000100:00080000:2.0:1788587257.401694:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788587257.416378:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:0.0:1788587257.416516:0:16596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045568 00000100:00100000:0.0:1788587257.416526:0:16596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045568 00000100:00100000:0.0:1788587257.416599:0:16596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:0.0:1788587257.416611:0:16596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac88268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+5:2358:x1875469182045568:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:0.0:1788587257.416648:0:16596:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab89e30 00000100:00080000:0.0:1788587257.416665:0:16596:0:(import.c:65:import_set_state_nolock()) ffff8bac8f08e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587257.416703:0:16596:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1788587257.417206:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788587257.417224:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587257.417380:0:16596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac88268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f609c3a5-c4ee-4a91-8ffd-01bcb8479d45+2:2358:x1875469182045568:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 422us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587257.417399:0:16596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 20 00000100:00100000:2.0:1788587257.425939:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587257.425993:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.28@tcp (source: 12345-192.168.204.28@tcp) 00000100:00100000:2.0:1788587257.426029:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045824 00000100:00100000:2.0:1788587257.426041:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045824 00000100:00100000:2.0:1788587257.426101:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469182045952 00000100:00100000:2.0:1788587257.426105:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469182045952 00000100:00100000:2.0:1788587257.426134:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00100000:2.0:1788587257.426143:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2358:x1875469182045824:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:2.0:1788587257.426173:0:15132:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab89e61 00000100:00080000:2.0:1788587257.426187:0:15132:0:(import.c:65:import_set_state_nolock()) ffff8bab81fd8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788587257.426230:0:15132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934597 00000100:00100000:0.0:1788587257.426426:0:15133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.28@tcp, seq: 22 00000100:00100000:0.0:1788587257.426439:0:15133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+5:2358:x1875469182045952:12345-192.168.204.28@tcp:9:kworker.0 00000020:00000080:0.0:1788587257.426464:0:15133:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc1a730b05ab89e68 00000100:00080000:0.0:1788587257.426471:0:15133:0:(import.c:65:import_set_state_nolock()) ffff8bab81fd8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788587257.426507:0:15133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788587257.426527:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35b9e3bf-ee50-43fc-85f3-0213efdb22be+2:2358:x1875469182045824:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 383us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587257.426536:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 21 00000100:00080000:2.0:1788587257.426559:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788587257.426563:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788587257.426579:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587257.426624:0:15133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35b9e3bf-ee50-43fc-85f3-0213efdb22be+2:2358:x1875469182045952:12345-192.168.204.28@tcp:9:kworker.0 Request processed in 189us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587257.426632:0:15133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.28@tcp, seq: 22 00010000:00010000:1.0:1788587257.426706:0:14435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788587257.783766:0:16717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788587258.179227:0:14436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788587258.952488:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788587258.952509:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00100000:0.0:1788587258.952519:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35b9e3bf-ee50-43fc-85f3-0213efdb22be 00000020:00000080:0.0:1788587258.952538:0:6730:0:(genops.c:885:class_export_put()) final put ffff8bab81fdc000/35b9e3bf-ee50-43fc-85f3-0213efdb22be 00000020:00000080:0.0:1788587258.952578:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8bab81fdc000/35b9e3bf-ee50-43fc-85f3-0213efdb22be for lustre-OST0000 00000020:00000080:0.0:1788587258.952628:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bab81fd8800 for lustre-OST0000 00010000:00010000:1.0:1788587259.203185:0:15661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788587259.395031:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788587259.395059:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208238208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788587259.395130:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788587259.395201:0:15134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208238208 00000100:00100000:0.0:1788587259.395209:0:15134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208238208 00000100:00100000:0.0:1788587259.395269:0:15134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788587259.395293:0:15134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacae64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208238208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788587259.395327:0:15134:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788587259.395393:0:15134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacae64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875469208238208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587259.395401:0:15134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788587259.395423:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788587259.395464:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacae64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875469208238208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788587259.402072:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208238464:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402138:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587259.402197:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788587259.402203:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208238592:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402225:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587259.402254:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208238464 00000100:00100000:2.0:1788587259.402261:0:15132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208238464 00000100:00100000:2.0:1788587259.402312:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587259.402328:0:15132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208238464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402403:0:15132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875469208238464:12345-0@lo:400:kworker.0 Request processed in 75us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587259.402410:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788587259.402433:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208238592 00000100:00100000:2.0:1788587259.402436:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208238592 00000100:00100000:2.0:1788587259.402462:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587259.402467:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208238592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402496:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875469208238592:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587259.402501:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788587259.402522:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208238720:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402545:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587259.402564:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788587259.402569:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208238336:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402593:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587259.402614:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bacbb8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208238848:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402632:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788587259.402654:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208238720 00000100:00100000:2.0:1788587259.402658:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208238720 00000100:00100000:2.0:1788587259.402679:0:16597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208238848 00000100:00100000:2.0:1788587259.402682:0:16597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208238848 00000100:00100000:2.0:1788587259.402700:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587259.402705:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208238720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402735:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875469208238720:12345-0@lo:400:kworker.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587259.402752:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788587259.402764:0:16597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587259.402769:0:16597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bacbb8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208238848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402794:0:16597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bacbb8d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875469208238848:12345-0@lo:400:kworker.0 Request processed in 25us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788587259.402801:0:16597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788587259.402874:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875469208238848:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402886:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875469208238720:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402916:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875469208238592:0@lo:400:kworker.0 00000100:00100000:2.0:1788587259.402923:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788587259.402928:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bab829ee300, transno 8589934595 00000004:00080000:2.0:1788587259.402939:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788587259.402954:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875469208238464:0@lo:400:kworker.0 00000100:00100000:0.0:1788587259.412897:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875469208238336 00000100:00100000:0.0:1788587259.412915:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875469208238336 00000100:00100000:0.0:1788587259.412984:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788587259.412993:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8bac85aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3312:x1875469208238336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788587259.413084:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8bac85aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7044063-f08f-49f3-baab-c8410dd7f9cc+19:3312:x1875469208238336:12345-0@lo:400:kworker.0 Request processed in 91us (10488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788587259.413090:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788587259.413127:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788587259.413132:0:14443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788587259.415002:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bacbb8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7044063-f08f-49f3-baab-c8410dd7f9cc:3312:1875469208238336:0@lo:400:kworker.0 00000001:00100000:1.0:1788587259.470314:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35b9e3bf-ee50-43fc-85f3-0213efdb22be 00000020:00000080:1.0:1788587259.470323:0:7665:0:(genops.c:885:class_export_put()) final put ffff8bab81fd9000/35b9e3bf-ee50-43fc-85f3-0213efdb22be 00000001:00100000:1.0:1788587259.470356:0:7665:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f609c3a5-c4ee-4a91-8ffd-01bcb8479d45 00000020:00000080:1.0:1788587259.470359:0:7665:0:(genops.c:885:class_export_put()) final put ffff8bac8f08d800/f609c3a5-c4ee-4a91-8ffd-01bcb8479d45 00000020:00000080:2.0:1788587259.470500:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bab81fd9000/35b9e3bf-ee50-43fc-85f3-0213efdb22be for lustre-OST0001 00000020:00000080:2.0:1788587259.470550:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8bac8f08d800/f609c3a5-c4ee-4a91-8ffd-01bcb8479d45 for lustre-OST0001 00000020:00000080:2.0:1788587259.470569:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bab81fd8000 for lustre-OST0001 00000020:00000080:2.0:1788587259.470573:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8bac8f08e000 for lustre-OST0001 Debug log: 30266 lines, 30266 kept, 0 dropped, 0 bad.